-- Logs begin at Fri 2022-08-26 17:43:24 UTC, end at Fri 2022-08-26 18:40:50 UTC. -- Aug 26 18:14:58.704552 dv-cinder-851996-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 18:14:58.712337 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 18:14:58 2022] *** Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: nodename: dv-cinder-851996-8-iscsi Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: machine: x86_64 Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: clock source: unix Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: pcre jit disabled Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: detected number of CPU cores: 4 Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: current working directory: / Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: detected binary path: /usr/bin/uwsgi-core Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: your processes number limit is 47680 Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: your memory page size is 4096 bytes Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: detected max file descriptor number: 2048 Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: lock engine: pthread robust mutexes Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: thunder lock: enabled Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 18:14:58.716615 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 18:14:58.754335 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: Python main interpreter initialized at 0x55eeaedb09c0 Aug 26 18:14:58.754335 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: python threads support enabled Aug 26 18:14:58.754335 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: your server socket listen backlog is limited to 100 connections Aug 26 18:14:58.754335 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: your mercy for graceful operations on workers is 90 seconds Aug 26 18:14:58.754695 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 18:14:58.754695 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: *** Operational MODE: preforking *** Aug 26 18:14:58.754964 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: *** uWSGI is running in multiple interpreter mode *** Aug 26 18:14:58.754964 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: spawned uWSGI master process (pid: 105529) Aug 26 18:14:58.755158 dv-cinder-851996-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 18:14:58.757509 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: spawned uWSGI worker 1 (pid: 105530, cores: 1) Aug 26 18:14:58.757509 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: spawned uWSGI worker 2 (pid: 105531, cores: 1) Aug 26 18:14:58.757509 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 18:14:59.406301 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 18:14:59.416748 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 18:15:00.476415 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 18:15:00.476415 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: from cryptography.utils import int_from_bytes Aug 26 18:15:00.477069 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 18:15:00.477069 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: from cryptography.utils import int_from_bytes Aug 26 18:15:00.479803 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 18:15:00.479803 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: from cryptography.utils import int_from_bytes Aug 26 18:15:00.480261 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 18:15:00.480261 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: from cryptography.utils import int_from_bytes Aug 26 18:15:02.919156 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 18:15:02.919696 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 18:15:02.919802 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 18:15:02.920171 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 18:15:02.920399 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 18:15:02.920829 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.920960 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 18:15:02.921353 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.921443 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 18:15:02.921522 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.921729 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 18:15:02.921872 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.922032 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.922121 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 18:15:02.922335 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 18:15:02.922479 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.922675 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.922820 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.923037 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.923183 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.923278 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.923359 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.923549 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.923659 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.923862 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.923972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.924171 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-8-iscsi {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.924280 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.924528 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.924625 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.924882 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.924973 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.925189 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.925280 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.925498 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.925595 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.925795 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.925909 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.926122 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.926218 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-8-iscsi {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.926423 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.926513 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.926734 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.926903 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.927012 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.928099 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.928228 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.928352 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.928445 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.928533 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.928612 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.928791 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.928878 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.928878 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.929073 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.929169 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.929259 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.929345 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.929437 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.929522 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.929631 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.929793 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.929980 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.930078 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.930295 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.930485 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-8-iscsi {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.930585 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.930802 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.930898 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.931113 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.931202 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.931422 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.931524 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.931804 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.931909 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.932126 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.932225 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-8-iscsi {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.932433 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.932562 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.932766 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.933002 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.933107 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.933208 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.933383 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.933507 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.933708 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.933802 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.934030 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.934175 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.934347 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.934435 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.934668 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.934766 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.934974 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.935091 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.935281 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.935379 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.935588 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.935684 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.935906 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.936001 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.936209 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.936317 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.936505 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.936608 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.936772 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.936869 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.937082 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.937191 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.937405 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.937502 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.937726 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.937818 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.938034 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.938137 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.938284 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.938381 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.938532 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.938631 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.938849 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.938947 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.939167 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.939263 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.939476 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.939571 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.939747 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.939835 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.939996 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.940084 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.940353 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.940452 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.940665 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.940771 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.940999 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.941092 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.941305 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.941404 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.941611 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.941712 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.941921 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.942015 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.942228 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.942328 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.942536 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.942622 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.942841 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.942934 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.943144 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.943239 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.943464 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.943550 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.943769 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.943865 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.944075 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.944178 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.944385 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.944481 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.944702 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.944817 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.945036 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.945128 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.945352 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.945437 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.945660 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.945745 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.945964 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.946050 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.946267 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.946361 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.946572 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.946667 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.946893 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.946988 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.947212 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.947299 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.947512 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.947609 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.947767 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.947853 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.948069 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.948162 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.948372 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.948468 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.948687 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.948852 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.949018 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.949106 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.949267 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.949362 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.949570 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.949657 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.949881 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.949981 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.950184 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.950278 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.950488 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.950582 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.950788 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.950873 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.951089 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.951184 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.951388 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.951476 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.951685 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.951771 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.951987 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.952077 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.952286 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.952372 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.952587 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.952675 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.952913 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.953002 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.953217 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.953303 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.953522 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.953608 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.953821 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.953920 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.954123 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.954223 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.954432 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.954547 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.954746 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.954843 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.955045 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.955148 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.955345 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.955438 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.955650 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.955840 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.956018 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.956152 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.956284 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.956415 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.956590 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.956753 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.956916 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.957019 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.957220 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.957307 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.957526 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.957613 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.957833 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.957920 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.958139 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.958243 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.958443 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.958529 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.958746 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.958831 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.959054 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.959221 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.959351 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.959437 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.959648 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.959741 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.959952 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.960047 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.960256 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.960341 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.960553 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.960638 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.960882 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.960988 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.961183 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.961268 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.961488 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.961575 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.961792 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.961878 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.962096 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.962194 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.962394 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.962494 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.962693 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.962787 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.963006 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.963090 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.963327 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.963425 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.963652 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.963761 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.963937 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.964028 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.964241 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.964327 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.964557 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:15:02.964651 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.964914 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.965001 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.965249 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.965347 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.965558 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.965643 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.965873 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.965959 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.966202 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.966296 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.966515 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.966608 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.966830 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.966916 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.967140 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.967232 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.967455 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.967541 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.967779 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.967866 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.968088 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.968173 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.968400 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.968485 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.968731 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.968834 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.969052 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.969149 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.969361 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.969446 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.969680 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.969777 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.969997 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.970084 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.970313 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.970625 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.970969 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.971163 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.971313 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.971520 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.971652 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.971843 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.971977 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.972173 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.972302 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.973963 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.974057 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.974157 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.974241 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.974320 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.974408 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.974488 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.974574 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.974707 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.974802 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.974893 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.975011 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.975114 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.975196 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.975282 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.975369 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.975462 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.975543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.975622 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.975700 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.975785 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.975870 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.975958 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.976182 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.976275 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.976513 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.976602 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.976873 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.977194 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.977285 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.977520 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.977617 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.977847 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.977939 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.978161 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.978259 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.978469 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.978566 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.978780 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.978878 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.979089 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.979185 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.979428 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.979560 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.979735 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.979891 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.980019 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.980116 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.980346 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.980491 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.980656 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.980871 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.980964 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.981116 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.981292 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.981425 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.981607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.981752 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.981918 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.982050 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.982191 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.982347 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.982500 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.982585 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.982822 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.982956 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.983131 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.983274 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.983412 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.983509 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.983744 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.983876 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.984050 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.984193 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.984344 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.984437 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.984645 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.984760 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.984981 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.985115 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.985294 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.985384 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.985597 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.985697 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.985906 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.986004 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.986212 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.986300 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.986519 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.986919 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.987187 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.987292 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.987498 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.987595 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.987803 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.987899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.988108 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.988212 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.988416 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.988504 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.988740 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.988830 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.989048 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.989151 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.989372 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.989462 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.989679 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.989768 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.989983 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.990075 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.990298 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.990388 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.990608 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.990706 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.990920 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.991011 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.991214 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.991298 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.991518 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.991603 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.991826 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.991921 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.992130 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.992217 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.992435 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.992521 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.992774 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.992868 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.993067 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.993155 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.993370 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.993465 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.993677 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.993762 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.993981 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.994066 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.994284 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.994382 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.994589 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.994674 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.994902 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.994986 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.995207 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.995299 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.995509 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.995596 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.995811 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.995896 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.996109 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.996206 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.996413 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.996497 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.996731 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.996818 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.997042 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.997137 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.997350 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.997435 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.997656 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.997741 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.997979 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.998065 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.998288 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.998374 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.998593 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.998678 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.998897 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.998983 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.999197 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.999282 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.999504 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.999589 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.999814 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:02.999901 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.000133 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.000220 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.000445 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.000541 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.000786 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.000876 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.001098 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.001195 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.001423 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.001523 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.001732 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.001819 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.002040 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.002124 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.002340 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.002434 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.002677 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.002774 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.002992 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.003077 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.003315 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.003411 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.003627 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.003713 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.003945 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.004037 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.004249 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.004343 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.004562 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.004657 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.004898 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.005028 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.005211 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.005307 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.005526 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.005623 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.005835 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.005922 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.006154 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.006241 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.006464 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.006550 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.006779 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.006865 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.007087 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.007181 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.007396 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.007487 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.007709 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.007803 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.008016 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.008102 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.008317 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.008401 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.008625 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.008741 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.008963 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.009050 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.009285 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.009369 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.009592 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.009690 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.009903 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.009996 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.010210 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.010303 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.010521 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.010622 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.010831 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.010922 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.011138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.011227 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.011442 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.011608 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.011742 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.011842 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.012051 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.012136 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.012364 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.012457 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.012674 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.012812 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.013008 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.013093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.013314 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.013402 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.013621 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.013706 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.013927 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.014013 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.014230 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.014318 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.014534 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.014619 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.014841 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.014925 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.015149 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.015242 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.015460 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.015551 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.015765 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.015858 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.016077 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.016164 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.016377 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.016462 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.016681 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.016798 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.017013 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.017110 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.017320 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.017405 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.017625 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.017718 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.017929 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.018023 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.018247 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.018362 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.018596 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.018691 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.018920 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.019017 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.019224 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.019309 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.019531 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.019624 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.019840 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.019926 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.020146 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.020241 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.020458 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.020545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.020792 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.020940 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.021102 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.021190 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.021407 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.021494 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.021719 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.021802 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.022027 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.022112 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.022335 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.022421 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.022640 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.022767 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.022950 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.023037 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.023257 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.023343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.023570 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.023656 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.023877 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.023973 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.024186 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.024279 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.024489 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.024574 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.024814 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.025126 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.025248 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.025441 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.025567 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.025750 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.026009 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.026096 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.026340 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.026426 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.026656 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.026749 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.026964 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.027050 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.027276 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.027361 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.027588 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.027690 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.027897 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.027998 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.028210 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.028296 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.028527 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.028612 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.028858 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.029125 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.029213 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.029461 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.029552 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.029765 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.029861 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.030075 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.030159 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.030378 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.030463 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.030684 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.030778 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.030989 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.031084 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.031299 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.031385 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.031600 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.031685 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.031903 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.032000 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.032206 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.032291 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.032511 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.032603 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.032850 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.032940 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.033156 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.033241 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.033468 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.033553 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.033771 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.033878 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.034103 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.034187 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.034407 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.034500 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.034711 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.034803 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.035013 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.035097 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.035312 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.035477 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.035618 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.035704 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.035937 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.036022 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.036243 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.036339 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.036557 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.036643 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.036888 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.036975 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.037212 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.037310 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.037514 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.037598 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.037817 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.037902 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.038123 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.038219 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.038425 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.038517 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.038730 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.038823 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.039039 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.039127 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.039346 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.039431 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.039650 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.039735 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.039961 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.040048 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.040272 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.040357 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.040580 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.040669 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.040916 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.041005 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.041220 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.041315 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.041525 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.041625 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.041827 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.041920 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.042137 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.042222 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.042444 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.042540 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.042742 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.042876 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.043089 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.043371 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.043475 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.043568 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.043648 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.043727 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.043925 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.044011 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.044229 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.044321 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.044529 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.044622 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.044861 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.044964 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.045162 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.045249 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.045466 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.045553 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.045768 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.045853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.046071 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.046164 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.046380 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.046467 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.046683 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.046776 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.046985 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.047071 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.047295 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.047380 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.047598 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.047683 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.047899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.047985 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.048205 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.048291 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.048508 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.048603 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.048837 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.048925 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.049149 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.049234 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.049459 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.049595 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.049813 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.049899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.050112 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.050198 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.050420 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.050519 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.050724 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.050810 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.051026 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.051109 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.051327 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.051420 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.051628 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.051720 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.051925 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.052010 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.052225 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.052312 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.052525 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.052610 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.052857 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.052948 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.053163 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.053295 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.053474 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.053559 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.053778 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.053865 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.054076 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.054163 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.054379 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.054472 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.054675 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.054767 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.054976 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.055063 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.055283 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.055383 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.055588 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.055692 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.055893 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.055979 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.056198 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.056285 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.056522 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.056617 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.056852 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.056952 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.057155 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.057240 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.057461 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.057561 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.057763 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.057859 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.058073 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.058158 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.058382 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.058476 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.058695 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.058781 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.059001 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.059089 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.059306 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.059393 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.059625 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.059711 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.059936 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.060029 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.060244 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.060331 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.060556 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.060649 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.060887 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.060975 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.061205 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.061301 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.061506 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.061592 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.061815 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.061903 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.062119 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.062205 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.062423 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.062507 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.062732 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.062817 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.063040 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.063132 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.063346 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.063432 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.063661 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.063837 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.063977 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.064070 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.064289 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.064376 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.064591 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.064692 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.064922 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.065009 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.065278 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.065368 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.065584 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.065686 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.065890 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.066026 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.066202 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.066288 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.066507 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.066600 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.066813 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.066906 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.067120 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.067204 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.067420 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.067507 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.067728 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.067813 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.068032 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.068115 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.068336 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.068457 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.068644 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.068804 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.068974 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.069118 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.069302 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.069425 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.069616 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.069738 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.069920 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.070049 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.070229 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.070364 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.070536 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.070678 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.070845 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.070981 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.071151 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.071396 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.071579 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.071711 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.071892 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.072024 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.072202 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.072336 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.072506 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.072641 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.072841 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.072974 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.073158 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.073284 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.073473 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.073608 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.073790 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.073914 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.074094 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.074217 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.074510 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.074595 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.074822 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.074910 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.075123 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.075215 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.075428 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.075513 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.075733 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.075844 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.076036 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.076152 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.076345 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.076456 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.076669 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.076904 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.076994 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.077217 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.077311 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.077534 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.077621 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.077857 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.077943 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.078178 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.078261 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.078498 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.078590 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.078804 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.078889 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.079118 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.079204 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.079428 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.079524 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.079749 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.079895 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.080071 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.080207 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.080383 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.080522 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.080696 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.080890 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.081041 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.081214 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.081366 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.081541 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.081691 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.081854 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.082002 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.082168 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.082325 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.082479 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.082735 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.082829 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.083057 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.083144 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.083371 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.083475 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.083690 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.083776 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.084003 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.084088 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.084306 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.084400 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.084610 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.084703 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.084948 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.085034 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.085253 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.085350 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.085557 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.085670 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.085881 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.085998 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.086186 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.086314 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.086498 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.086640 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.086809 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.086969 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.087117 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.087275 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.087420 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.087579 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.087729 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.087894 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.088050 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.088200 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.088353 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.088508 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.088672 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.088854 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.089008 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.089161 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.089330 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.089480 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.089650 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.089792 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.089953 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.090102 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.090277 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.090408 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.090584 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.090713 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.090886 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.091037 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.091190 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.091342 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.091492 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.091664 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.091852 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.091974 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.092138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.092286 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.092457 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.092607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.092812 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.092940 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.093145 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.093265 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.093458 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.093575 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.093792 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.093878 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.094114 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.094208 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.094431 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.094519 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.094751 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.094838 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.095071 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.095163 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.095372 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.095459 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.095675 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.095771 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.095984 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.096077 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.096291 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.096414 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.096643 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.096755 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.096985 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.097085 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.097292 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.097380 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.097598 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.097684 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.097900 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.097995 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.098204 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.098298 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.098523 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.098608 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.098828 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.098926 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.099132 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.099217 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.099442 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.099534 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.099743 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.099838 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.100047 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.100140 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.100346 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.100431 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.100648 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.100757 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.100988 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.101086 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.101312 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.101397 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.101616 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.101703 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.101940 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.102057 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.102247 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.102346 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.102553 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.102651 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.102858 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.102955 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.103160 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.103258 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.103473 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.103570 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.103786 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.103871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.104096 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.104192 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.104405 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.104491 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.104752 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.104884 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.105052 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.105148 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.105365 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.105468 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.105682 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.105877 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.105998 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.106207 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.106320 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.106520 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.106638 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.106833 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.106953 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.107146 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.107264 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.107461 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.107582 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.107780 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.107897 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.108090 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.108215 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.108405 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.108731 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.108820 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.109045 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.109134 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.109375 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.109462 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.109685 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.109770 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.110000 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.110100 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.110317 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.110412 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.110632 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.110798 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.110944 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.111038 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.111252 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.111345 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.111862 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.112046 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.112204 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.112299 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.112536 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.112623 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.112869 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.112972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.113187 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.113274 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.113507 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.113644 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.113820 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.113916 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.114132 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.114218 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.114443 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.114530 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.114756 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.114843 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.115066 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.115159 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.115375 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.115471 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.115685 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.115772 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.115997 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.116083 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.116313 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.116419 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.116631 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.116772 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.116968 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.117065 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.117281 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.117377 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.117598 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.117685 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.117906 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.117992 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.118215 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.118303 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.118525 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.118729 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.118840 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.119047 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.119148 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.119380 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.119467 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.119706 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.119792 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.120031 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.120126 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.120349 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.120443 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.120666 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.120771 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.121013 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.121101 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.121322 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.121534 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.121620 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.121849 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.121944 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.122182 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.122280 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.122501 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.122589 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.122822 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.122916 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.123130 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.123223 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.123434 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.123520 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.123753 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.123848 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.124056 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.124142 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.124363 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.124581 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.124678 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.124956 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.125090 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.125275 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.125361 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.125592 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.125688 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.125905 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.125991 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.126211 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.126296 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.126513 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.126608 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.126824 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.126909 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.127129 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.127357 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.127443 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.127753 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.127844 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.128074 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.128159 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.128402 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.128496 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.128738 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.128839 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.129059 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.129152 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.129371 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.129465 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.129675 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.129761 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.129985 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.130079 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.130290 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.130390 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.130610 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.130696 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.130913 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.131005 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.131218 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.131317 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.131522 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.131607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.131833 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.131918 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.132136 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.132266 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.132440 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.132526 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.132767 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.132857 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.133077 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.133164 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.133391 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.133486 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.133697 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.133819 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.134001 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.134087 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.134303 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.134391 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.134615 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.134708 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.134917 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.135003 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.135223 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.135324 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.135533 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.135629 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.135842 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.135927 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.136155 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.136240 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.136454 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.136550 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.136784 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.136892 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.137092 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.137185 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.137404 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.137499 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.137713 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.137800 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.138021 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.138113 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.138366 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.138461 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.138682 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.138773 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.138988 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.139210 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.139305 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.139545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.139631 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.139867 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.139954 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.140207 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.140301 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.140526 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.140644 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.140859 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.140958 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.141167 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.141281 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.141474 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.141569 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.141800 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.142019 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.142123 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.142354 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.142459 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.142677 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.142781 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.143004 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.143114 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.143347 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.143444 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.143652 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.143747 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.143959 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.144071 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.144263 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.144358 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.144572 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.144668 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.144905 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.145013 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.145214 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.145373 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.145515 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.145648 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.145815 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.145957 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.146121 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.146261 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.146432 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.146574 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.146741 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.146887 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.147052 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.147183 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.147363 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.147496 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.147705 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.147839 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.147975 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.148107 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.148262 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.148405 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.148566 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.148706 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.148896 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.148982 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.149203 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.149302 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.149519 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.149605 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.149848 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.149936 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.150160 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.150256 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.150463 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.150550 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.150782 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.150868 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.151093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.151193 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.151403 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.151490 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.151714 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.151811 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.152024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.152113 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.152344 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.152450 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.152674 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.152788 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.153009 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.153098 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.153310 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.153397 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.153625 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.153721 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.153951 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.154045 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.154290 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.154386 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.154615 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.154722 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.154939 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.155026 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.155245 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.155354 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.155553 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.155657 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.155859 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.155955 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.156168 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.156256 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.156479 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.156628 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.156804 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.156935 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.157111 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.157197 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.157421 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.157526 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.157733 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.157821 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.158037 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.158123 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.158342 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.158436 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.158649 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.158738 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.159001 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.159088 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.159309 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.159406 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.159611 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.159699 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.159914 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.160000 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.160214 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.160301 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.160518 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.160615 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.160842 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.160946 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.161144 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.161231 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.161446 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.161531 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.161745 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.161840 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.162049 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.162136 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.162350 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.162435 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.162650 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.162745 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.162951 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.163044 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.163257 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.163344 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.163561 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.163649 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.163866 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.163961 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.164172 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.164276 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.164479 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.164568 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.164815 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.164905 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.165123 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.165223 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.165429 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.165517 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.165734 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.165821 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.166044 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.166132 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.166354 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.166449 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.166685 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.166780 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.166994 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.167102 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.167306 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.167421 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.167621 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.167715 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.167926 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.168021 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.168232 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.168319 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.168544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.168632 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.168878 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.168980 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.169233 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.169329 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.169496 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.169591 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.169821 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.169918 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.170130 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.170217 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.170441 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.170529 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.170750 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.170848 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.171058 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.171146 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.171365 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.171461 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.171682 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.171779 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.171993 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.172081 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.172298 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.172385 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.172608 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.172753 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.172944 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.173043 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.173259 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.173361 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.173568 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.173658 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.173877 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.173962 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.174203 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.174303 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.174526 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.174632 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.174841 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.174929 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.175153 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.175250 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.175474 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.175568 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.175770 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.175864 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.176087 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.176178 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.176399 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.176487 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.176723 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.176811 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.177050 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.177138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.177367 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.177453 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.177692 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.177790 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.178001 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.178090 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.178306 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.178393 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.178549 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 18:15:03.178645 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.178945 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.179291 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.179610 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.179955 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.180284 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.180602 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.180937 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.181249 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:15:03.181492 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 18:15:03.333047 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO dbcounter [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Registered counter for database nova_api Aug 26 18:15:03.335288 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO dbcounter [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] Registered counter for database nova_api Aug 26 18:15:03.355762 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_db.sqlalchemy.engines [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:15:03.357371 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG oslo_db.sqlalchemy.engines [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:15:03.365559 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writer thread running {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:15:03.367972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writer thread running {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:15:03.426298 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.context [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b13be996-0005-4abd-8d43-d4c756a0aa08(cell1) {{(pid=105530) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 18:15:03.426511 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.context [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b13be996-0005-4abd-8d43-d4c756a0aa08(cell1) {{(pid=105531) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 18:15:03.430207 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:15:03.430344 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:15:03.430674 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:15:03.430809 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:15:03.432230 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:15:03.432366 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:15:03.432995 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:15:03.433122 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:15:03.433421 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:15:03.433572 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:15:03.435413 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:15:03.435557 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG oslo_concurrency.lockutils [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:15:03.437425 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO dbcounter [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Registered counter for database nova_cell0 Aug 26 18:15:03.437575 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO dbcounter [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] Registered counter for database nova_cell0 Aug 26 18:15:03.441657 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO dbcounter [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Registered counter for database nova_cell1 Aug 26 18:15:03.442824 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO dbcounter [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] Registered counter for database nova_cell1 Aug 26 18:15:03.449551 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_db.sqlalchemy.engines [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:15:03.451280 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_db.sqlalchemy.engines [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:15:03.452686 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG oslo_db.sqlalchemy.engines [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:15:03.456636 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG oslo_db.sqlalchemy.engines [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:15:03.457104 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writer thread running {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:15:03.458723 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writer thread running {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:15:03.462347 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writer thread running {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:15:03.595002 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writer thread running {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:15:03.600401 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO dbcounter [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Registered counter for database nova_cell0 Aug 26 18:15:03.604315 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO dbcounter [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] Registered counter for database nova_cell0 Aug 26 18:15:03.610002 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_db.sqlalchemy.engines [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:15:03.613816 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG oslo_db.sqlalchemy.engines [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:15:03.616147 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writer thread running {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:15:03.618606 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writer thread running {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:15:03.950931 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: WARNING keystonemiddleware.auth_token [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 18:15:03.958308 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: WARNING keystonemiddleware.auth_token [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 18:15:03.966579 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: WARNING keystonemiddleware.auth_token [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 18:15:03.973979 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: WARNING keystonemiddleware.auth_token [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 18:15:04.291383 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: WARNING keystonemiddleware.auth_token [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 18:15:04.297335 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: WARNING keystonemiddleware.auth_token [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 18:15:04.302624 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55eeaedb09c0 pid: 105531 (default app) Aug 26 18:15:04.304685 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:15:04.305903 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 Aug 26 18:15:04.306318 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Fri Aug 26 18:15:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:15:04.309826 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: WARNING keystonemiddleware.auth_token [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 18:15:04.315920 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: WARNING keystonemiddleware.auth_token [None req-e94a0d1b-186c-4f2a-ad98-458951570a92 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 18:15:04.321172 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55eeaedb09c0 pid: 105530 (default app) Aug 26 18:16:22.011090 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:16:22.012080 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 26 18:16:22.012651 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 931 bytes} [Fri Aug 26 18:16:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:16:22.028517 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_api:SELECT=3 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:22.030195 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_cell0:SELECT=3 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:22.031077 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_cell1:SELECT=3 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:22.032183 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:22.915340 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-c6e01e8e-12d0-4398-9bdf-8f6b5a9b92f3 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:16:22.949410 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-c6e01e8e-12d0-4398-9bdf-8f6b5a9b92f3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.929793 Aug 26 18:16:22.950178 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1292 bytes} [Fri Aug 26 18:16:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:16:25.254225 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:16:25.255486 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-c29599d8-d0ce-4f8a-8a4e-33fe4c6e2569 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Aug 26 18:16:25.260473 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 931 bytes} [Fri Aug 26 18:16:25 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:16:25.718662 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-a0d3aff0-e9cf-41d3-9e6d-d575a09f60d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:25.772304 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-a0d3aff0-e9cf-41d3-9e6d-d575a09f60d5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.509978 Aug 26 18:16:25.773493 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1283 bytes} [Fri Aug 26 18:16:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 18:16:25.997773 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-6461ebf8-6351-4835-9346-005026f53cf8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:26.005048 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_api:SELECT=3 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:26.006196 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_cell0:SELECT=3 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:26.007250 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_cell1:SELECT=3 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:26.008213 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:26.069801 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-6461ebf8-6351-4835-9346-005026f53cf8 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288012 Aug 26 18:16:26.070396 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1336 bytes} [Fri Aug 26 18:16:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:16:28.375365 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-a0d3aff0-e9cf-41d3-9e6d-d575a09f60d5 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:16:28.376296 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-a0d3aff0-e9cf-41d3-9e6d-d575a09f60d5 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 26 18:16:28.376893 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 931 bytes} [Fri Aug 26 18:16:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:16:29.046807 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-1c457b2c-9798-4729-8b13-00dc92c75d81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "ram": 512}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:29.091162 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-1c457b2c-9798-4729-8b13-00dc92c75d81 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.706746 Aug 26 18:16:29.091766 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1283 bytes} [Fri Aug 26 18:16:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:16:29.104225 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-48874e8e-0ce5-4616-abcf-1e29df33121f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:29.140694 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-48874e8e-0ce5-4616-abcf-1e29df33121f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040177 Aug 26 18:16:29.141416 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1336 bytes} [Fri Aug 26 18:16:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:16:31.592106 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-1c457b2c-9798-4729-8b13-00dc92c75d81 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:16:31.593919 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-1c457b2c-9798-4729-8b13-00dc92c75d81 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002502 Aug 26 18:16:31.594336 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 931 bytes} [Fri Aug 26 18:16:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:16:31.989539 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-edf62966-ce1d-4b91-ac2a-cb6a7a6edaf1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:32.009059 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-edf62966-ce1d-4b91-ac2a-cb6a7a6edaf1 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.408296 Aug 26 18:16:32.009811 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1283 bytes} [Fri Aug 26 18:16:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:16:32.021722 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-198b10d7-bde1-448c-bd57-23b699128e39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:32.046688 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-198b10d7-bde1-448c-bd57-23b699128e39 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028812 Aug 26 18:16:32.047185 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1336 bytes} [Fri Aug 26 18:16:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:16:34.367978 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-edf62966-ce1d-4b91-ac2a-cb6a7a6edaf1 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:16:34.369606 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-edf62966-ce1d-4b91-ac2a-cb6a7a6edaf1 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002145 Aug 26 18:16:34.386383 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 931 bytes} [Fri Aug 26 18:16:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:16:34.814287 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-feb904ab-77bb-40c9-bd79-1097d5a05ac6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:34.836067 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-feb904ab-77bb-40c9-bd79-1097d5a05ac6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.451972 Aug 26 18:16:34.836861 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1283 bytes} [Fri Aug 26 18:16:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:16:34.848497 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-2fc07ee7-b0b7-4372-bc2b-50e3ff38c279 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:34.874733 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-2fc07ee7-b0b7-4372-bc2b-50e3ff38c279 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029826 Aug 26 18:16:34.876087 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1336 bytes} [Fri Aug 26 18:16:34 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:16:37.186955 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-feb904ab-77bb-40c9-bd79-1097d5a05ac6 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:16:37.187963 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-feb904ab-77bb-40c9-bd79-1097d5a05ac6 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 26 18:16:37.188622 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 931 bytes} [Fri Aug 26 18:16:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:16:37.607803 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-606632e6-3b90-4f9f-9dad-7b83addc3299 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:37.628311 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-606632e6-3b90-4f9f-9dad-7b83addc3299 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433650 Aug 26 18:16:37.628860 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1283 bytes} [Fri Aug 26 18:16:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 18:16:37.641190 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-2c72ff11-ab38-4f83-abc3-38e69b7b0f28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:37.667376 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-2c72ff11-ab38-4f83-abc3-38e69b7b0f28 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030068 Aug 26 18:16:37.672572 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1336 bytes} [Fri Aug 26 18:16:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:16:39.954996 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-606632e6-3b90-4f9f-9dad-7b83addc3299 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:16:39.956010 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-606632e6-3b90-4f9f-9dad-7b83addc3299 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 26 18:16:39.956386 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 931 bytes} [Fri Aug 26 18:16:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:16:40.379269 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-09d60faf-8647-4162-9ab2-7ba36a413827 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:16:40.403876 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-09d60faf-8647-4162-9ab2-7ba36a413827 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.440698 Aug 26 18:16:40.404680 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1292 bytes} [Fri Aug 26 18:16:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:16:42.721537 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-606632e6-3b90-4f9f-9dad-7b83addc3299 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:16:42.722560 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-606632e6-3b90-4f9f-9dad-7b83addc3299 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 26 18:16:42.722934 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 931 bytes} [Fri Aug 26 18:16:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:16:43.161817 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-6c2e5987-e4da-4fed-b478-0f390e54f9d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "id": "1", "name": "m1.tiny"}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:43.182843 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-6c2e5987-e4da-4fed-b478-0f390e54f9d6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.451694 Aug 26 18:16:43.183384 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1283 bytes} [Fri Aug 26 18:16:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:16:43.197666 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-e9eef1bc-e723-4e7a-be7d-ab44a13526e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:43.226292 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-e9eef1bc-e723-4e7a-be7d-ab44a13526e4 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032356 Aug 26 18:16:43.226876 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1333 bytes} [Fri Aug 26 18:16:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:16:45.560572 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-6c2e5987-e4da-4fed-b478-0f390e54f9d6 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:16:45.561700 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-6c2e5987-e4da-4fed-b478-0f390e54f9d6 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Aug 26 18:16:45.562080 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 931 bytes} [Fri Aug 26 18:16:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:16:45.968741 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-5def29fd-74b1-4c6a-bef4-8845cc60ff0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 2048, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "id": "2"}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:45.988658 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-5def29fd-74b1-4c6a-bef4-8845cc60ff0d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.420252 Aug 26 18:16:45.989248 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1283 bytes} [Fri Aug 26 18:16:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:16:46.001813 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-06e6fc07-e4eb-483d-b8be-53329afe4928 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:46.026504 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-06e6fc07-e4eb-483d-b8be-53329afe4928 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028305 Aug 26 18:16:46.027242 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1333 bytes} [Fri Aug 26 18:16:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:16:48.349080 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-5def29fd-74b1-4c6a-bef4-8845cc60ff0d admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:16:48.350162 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-5def29fd-74b1-4c6a-bef4-8845cc60ff0d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 26 18:16:48.350589 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 931 bytes} [Fri Aug 26 18:16:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:16:48.723043 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-c47b4c99-2b40-4e79-b99a-853f9cddb1f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "id": "3"}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:48.742344 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-c47b4c99-2b40-4e79-b99a-853f9cddb1f4 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.385460 Aug 26 18:16:48.743095 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1283 bytes} [Fri Aug 26 18:16:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:16:48.756501 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-1cabc5de-66e4-4976-918f-c30a4acc5cc5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:48.783369 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-1cabc5de-66e4-4976-918f-c30a4acc5cc5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031284 Aug 26 18:16:48.784382 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1333 bytes} [Fri Aug 26 18:16:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:16:51.131817 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-c47b4c99-2b40-4e79-b99a-853f9cddb1f4 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:16:51.133482 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-c47b4c99-2b40-4e79-b99a-853f9cddb1f4 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 26 18:16:51.133889 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 931 bytes} [Fri Aug 26 18:16:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:16:51.586584 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-2f47ffd9-bd9f-44ab-8f3d-b5f8bfe19119 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:51.610362 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-2f47ffd9-bd9f-44ab-8f3d-b5f8bfe19119 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.470193 Aug 26 18:16:51.617035 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1283 bytes} [Fri Aug 26 18:16:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 18:16:51.623457 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-30bccc3b-9e69-42df-89e9-86af7ff42083 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:51.652984 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-30bccc3b-9e69-42df-89e9-86af7ff42083 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033353 Aug 26 18:16:51.654096 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1333 bytes} [Fri Aug 26 18:16:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:16:53.990835 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-2f47ffd9-bd9f-44ab-8f3d-b5f8bfe19119 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:16:53.992872 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-2f47ffd9-bd9f-44ab-8f3d-b5f8bfe19119 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002462 Aug 26 18:16:53.993275 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 931 bytes} [Fri Aug 26 18:16:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:16:54.436919 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-520e6e06-1b1e-41f8-81ce-df40ada70bc7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "vcpus": 8, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:54.459615 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-520e6e06-1b1e-41f8-81ce-df40ada70bc7 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.460104 Aug 26 18:16:54.460884 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1283 bytes} [Fri Aug 26 18:16:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 18:16:54.473053 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-acc60b9d-7837-430e-9a24-43823fe2e59f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:16:54.478202 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:16:54.505911 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-acc60b9d-7837-430e-9a24-43823fe2e59f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036349 Aug 26 18:16:54.506462 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1333 bytes} [Fri Aug 26 18:16:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:17:13.924384 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-520e6e06-1b1e-41f8-81ce-df40ada70bc7 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:13.925442 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-520e6e06-1b1e-41f8-81ce-df40ada70bc7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 26 18:17:13.925875 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 931 bytes} [Fri Aug 26 18:17:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:17:13.936528 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:14.348513 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-8b85a090-4a73-44a0-b6ad-1af60671b53a admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:14.367037 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-8b85a090-4a73-44a0-b6ad-1af60671b53a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.434975 Aug 26 18:17:14.367583 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1292 bytes} [Fri Aug 26 18:17:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:17:15.424313 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-520e6e06-1b1e-41f8-81ce-df40ada70bc7 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:15.425362 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-520e6e06-1b1e-41f8-81ce-df40ada70bc7 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 26 18:17:15.425763 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Aug 26 18:17:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:17:15.984461 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-e81002d8-5c9d-40bc-b927-ad4f8edd180a admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:15.990282 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.wsgi [None req-e81002d8-5c9d-40bc-b927-ad4f8edd180a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-e81002d8-5c9d-40bc-b927-ad4f8edd180a admin admin] Request method failure captured: Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Accept: application/json Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Accept-Encoding: gzip, deflate Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Connection: keep-alive Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Content-Length: 0 Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Host: 10.222.0.45 Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Openstack-Api-Version: compute 2.90 Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Openstack-System-Scope: None Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: User-Agent: python-novaclient Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Auth-Token: gAAAAABjCQ4r-deqhHJnpPFq6rzzyiD24A5fb89_xJu6XKMF-jocz3bahZg7JZprJL_3PPpyCDVoe5_Zc1DrSK4uBGrUJx0_kBVBJEpKyD4lluWlNPBKCWWzjqbZHuJG-YRWkq6FntTdBDPs8klmexFI8Pc0pfrx6tnFjbWdATkekzX-OEX8Tq0 Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Domain-Id: None Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Domain-Name: None Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Identity-Status: Confirmed Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Is-Admin-Project: True Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Project-Domain-Id: default Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Project-Domain-Name: Default Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Project-Id: 8a44db81f3af4ce4ac409fec8e68c2cd Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Project-Name: admin Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Role: reader,member,admin Aug 26 18:17:15.994020 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Roles: reader,member,admin Aug 26 18:17:15.995707 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a44db81f3af4ce4ac409fec8e68c2cd", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a44db81f3af4ce4ac409fec8e68c2cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a44db81f3af4ce4ac409fec8e68c2cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a44db81f3af4ce4ac409fec8e68c2cd"}]}] Aug 26 18:17:15.995707 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Tenant: admin Aug 26 18:17:15.995707 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Tenant-Id: 8a44db81f3af4ce4ac409fec8e68c2cd Aug 26 18:17:15.995707 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Tenant-Name: admin Aug 26 18:17:15.995707 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-User: admin Aug 26 18:17:15.995707 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-User-Domain-Id: default Aug 26 18:17:15.995707 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-User-Domain-Name: Default Aug 26 18:17:15.995707 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-User-Id: 5d269ce658414d469f0da1f990d74895 Aug 26 18:17:15.995707 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-User-Name: admin Aug 26 18:17:15.995707 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: method: > Aug 26 18:17:15.995707 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: exception: Flavor 42 could not be found. Aug 26 18:17:15.995707 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: action_args: {'id': '42'} Aug 26 18:17:15.995707 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:17:15.995707 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:17:15.996607 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Aug 26 18:17:15.998024 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-e81002d8-5c9d-40bc-b927-ad4f8edd180a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:17:15.999287 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-e81002d8-5c9d-40bc-b927-ad4f8edd180a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.432198 Aug 26 18:17:15.999287 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Aug 26 18:17:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:16.005321 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-9f80c67f-253a-4c61-8a3d-924114acafba admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:16.009583 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:17:16.029294 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-9f80c67f-253a-4c61-8a3d-924114acafba admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027446 Aug 26 18:17:16.029769 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Aug 26 18:17:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:17:16.040331 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-d412accb-37e4-4cdc-b112-cbda986c19ed admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:16.064375 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-d412accb-37e4-4cdc-b112-cbda986c19ed admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028294 Aug 26 18:17:16.064974 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Aug 26 18:17:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:17:16.077563 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-c77d1244-46e5-4566-aa50-f7ec1d86145e admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:16.086175 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.wsgi [None req-c77d1244-46e5-4566-aa50-f7ec1d86145e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-c77d1244-46e5-4566-aa50-f7ec1d86145e admin admin] Request method failure captured: Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Accept: application/json Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Accept-Encoding: gzip, deflate Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Connection: keep-alive Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Content-Length: 0 Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Host: 10.222.0.45 Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Openstack-Api-Version: compute 2.90 Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Openstack-System-Scope: None Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: User-Agent: python-novaclient Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Auth-Token: gAAAAABjCQ4r-deqhHJnpPFq6rzzyiD24A5fb89_xJu6XKMF-jocz3bahZg7JZprJL_3PPpyCDVoe5_Zc1DrSK4uBGrUJx0_kBVBJEpKyD4lluWlNPBKCWWzjqbZHuJG-YRWkq6FntTdBDPs8klmexFI8Pc0pfrx6tnFjbWdATkekzX-OEX8Tq0 Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Domain-Id: None Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Domain-Name: None Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Identity-Status: Confirmed Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Is-Admin-Project: True Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Project-Domain-Id: default Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Project-Domain-Name: Default Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Project-Id: 8a44db81f3af4ce4ac409fec8e68c2cd Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Project-Name: admin Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Role: reader,member,admin Aug 26 18:17:16.089477 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Roles: reader,member,admin Aug 26 18:17:16.090962 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a44db81f3af4ce4ac409fec8e68c2cd", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a44db81f3af4ce4ac409fec8e68c2cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a44db81f3af4ce4ac409fec8e68c2cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a44db81f3af4ce4ac409fec8e68c2cd"}]}] Aug 26 18:17:16.090962 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Tenant: admin Aug 26 18:17:16.090962 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Tenant-Id: 8a44db81f3af4ce4ac409fec8e68c2cd Aug 26 18:17:16.090962 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Tenant-Name: admin Aug 26 18:17:16.090962 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-User: admin Aug 26 18:17:16.090962 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-User-Domain-Id: default Aug 26 18:17:16.090962 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-User-Domain-Name: Default Aug 26 18:17:16.090962 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-User-Id: 5d269ce658414d469f0da1f990d74895 Aug 26 18:17:16.090962 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-User-Name: admin Aug 26 18:17:16.090962 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: method: > Aug 26 18:17:16.090962 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: exception: Flavor 42 could not be found. Aug 26 18:17:16.090962 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: action_args: {'id': '42'} Aug 26 18:17:16.090962 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:17:16.090962 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:17:16.091899 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 26 18:17:16.093138 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-c77d1244-46e5-4566-aa50-f7ec1d86145e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:17:16.094260 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-c77d1244-46e5-4566-aa50-f7ec1d86145e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.019311 Aug 26 18:17:16.094260 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Aug 26 18:17:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 26 18:17:17.071150 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-d412accb-37e4-4cdc-b112-cbda986c19ed admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:17.072158 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-d412accb-37e4-4cdc-b112-cbda986c19ed admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 26 18:17:17.072548 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Aug 26 18:17:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:17:17.614540 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-b9889f65-1893-46ac-ba04-856445007f3e admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:17.622395 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.wsgi [None req-b9889f65-1893-46ac-ba04-856445007f3e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-b9889f65-1893-46ac-ba04-856445007f3e admin admin] Request method failure captured: Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Accept: application/json Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Accept-Encoding: gzip, deflate Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Connection: keep-alive Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Content-Length: 0 Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Host: 10.222.0.45 Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Openstack-Api-Version: compute 2.90 Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Openstack-System-Scope: None Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: User-Agent: python-novaclient Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Auth-Token: gAAAAABjCQ4sKOuW_9Vg9ObG19m_C3s9VQDFpH2mABVhD6WZrIaRunGlbSvujFnOqCIWM4o2vBnhJIhCCgWgzu9FdqO0VsnHOhOvWyRsHegbSEmGB7tJrnKeUXgGN84BYnT-ponUK0A7-5UFUE8AgpaU4KxTIu42b9uUnKg5LxkvkTpfyuCiBh8 Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Domain-Id: None Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Domain-Name: None Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Identity-Status: Confirmed Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Is-Admin-Project: True Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Project-Domain-Id: default Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Project-Domain-Name: Default Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Project-Id: 8a44db81f3af4ce4ac409fec8e68c2cd Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Project-Name: admin Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Role: reader,member,admin Aug 26 18:17:17.624544 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Roles: reader,member,admin Aug 26 18:17:17.626062 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a44db81f3af4ce4ac409fec8e68c2cd", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a44db81f3af4ce4ac409fec8e68c2cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a44db81f3af4ce4ac409fec8e68c2cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a44db81f3af4ce4ac409fec8e68c2cd"}]}] Aug 26 18:17:17.626062 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Tenant: admin Aug 26 18:17:17.626062 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Tenant-Id: 8a44db81f3af4ce4ac409fec8e68c2cd Aug 26 18:17:17.626062 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Tenant-Name: admin Aug 26 18:17:17.626062 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-User: admin Aug 26 18:17:17.626062 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-User-Domain-Id: default Aug 26 18:17:17.626062 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-User-Domain-Name: Default Aug 26 18:17:17.626062 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-User-Id: 5d269ce658414d469f0da1f990d74895 Aug 26 18:17:17.626062 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-User-Name: admin Aug 26 18:17:17.626062 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: method: > Aug 26 18:17:17.626062 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: exception: Flavor 84 could not be found. Aug 26 18:17:17.626062 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: action_args: {'id': '84'} Aug 26 18:17:17.626062 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:17:17.626062 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:17:17.627020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 26 18:17:17.628343 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-b9889f65-1893-46ac-ba04-856445007f3e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:17:17.629684 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-b9889f65-1893-46ac-ba04-856445007f3e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.411339 Aug 26 18:17:17.629684 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Aug 26 18:17:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:17.636215 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-65fe8df4-0969-4f4e-b5d0-588ccaa6ae9c admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:17.651414 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-65fe8df4-0969-4f4e-b5d0-588ccaa6ae9c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018958 Aug 26 18:17:17.651954 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Aug 26 18:17:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:17:17.661500 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-dd3dc9d5-d447-473b-abf3-2fcbae7c397a admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:17.677309 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-dd3dc9d5-d447-473b-abf3-2fcbae7c397a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019320 Aug 26 18:17:17.677835 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Aug 26 18:17:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:17:17.689836 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-f547bf19-84b4-4e02-8180-da404070e544 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:17.698123 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.wsgi [None req-f547bf19-84b4-4e02-8180-da404070e544 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-f547bf19-84b4-4e02-8180-da404070e544 admin admin] Request method failure captured: Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Accept: application/json Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Accept-Encoding: gzip, deflate Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Connection: keep-alive Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Content-Length: 0 Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Host: 10.222.0.45 Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Openstack-Api-Version: compute 2.90 Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Openstack-System-Scope: None Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: User-Agent: python-novaclient Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Auth-Token: gAAAAABjCQ4sKOuW_9Vg9ObG19m_C3s9VQDFpH2mABVhD6WZrIaRunGlbSvujFnOqCIWM4o2vBnhJIhCCgWgzu9FdqO0VsnHOhOvWyRsHegbSEmGB7tJrnKeUXgGN84BYnT-ponUK0A7-5UFUE8AgpaU4KxTIu42b9uUnKg5LxkvkTpfyuCiBh8 Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Domain-Id: None Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Domain-Name: None Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Identity-Status: Confirmed Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Is-Admin-Project: True Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Project-Domain-Id: default Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Project-Domain-Name: Default Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Project-Id: 8a44db81f3af4ce4ac409fec8e68c2cd Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Project-Name: admin Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Role: reader,member,admin Aug 26 18:17:17.700543 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Roles: reader,member,admin Aug 26 18:17:17.702711 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a44db81f3af4ce4ac409fec8e68c2cd", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a44db81f3af4ce4ac409fec8e68c2cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a44db81f3af4ce4ac409fec8e68c2cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a44db81f3af4ce4ac409fec8e68c2cd"}]}] Aug 26 18:17:17.702711 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Tenant: admin Aug 26 18:17:17.702711 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Tenant-Id: 8a44db81f3af4ce4ac409fec8e68c2cd Aug 26 18:17:17.702711 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Tenant-Name: admin Aug 26 18:17:17.702711 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-User: admin Aug 26 18:17:17.702711 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-User-Domain-Id: default Aug 26 18:17:17.702711 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-User-Domain-Name: Default Aug 26 18:17:17.702711 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-User-Id: 5d269ce658414d469f0da1f990d74895 Aug 26 18:17:17.702711 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-User-Name: admin Aug 26 18:17:17.702711 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: method: > Aug 26 18:17:17.702711 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: exception: Flavor 84 could not be found. Aug 26 18:17:17.702711 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: action_args: {'id': '84'} Aug 26 18:17:17.702711 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:17:17.702711 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:17:17.703580 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Aug 26 18:17:17.704972 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-f547bf19-84b4-4e02-8180-da404070e544 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:17:17.706236 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-f547bf19-84b4-4e02-8180-da404070e544 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.018129 Aug 26 18:17:17.706236 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Aug 26 18:17:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:18.690436 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-dd3dc9d5-d447-473b-abf3-2fcbae7c397a admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:18.691446 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-dd3dc9d5-d447-473b-abf3-2fcbae7c397a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 26 18:17:18.691845 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Aug 26 18:17:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:17:19.253049 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-9bbcba6a-60a0-49c3-a604-065af7f26da6 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:19.258980 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.wsgi [None req-9bbcba6a-60a0-49c3-a604-065af7f26da6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-9bbcba6a-60a0-49c3-a604-065af7f26da6 admin admin] Request method failure captured: Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Accept: application/json Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Accept-Encoding: gzip, deflate Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Connection: keep-alive Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Content-Length: 0 Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Host: 10.222.0.45 Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Openstack-Api-Version: compute 2.90 Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Openstack-System-Scope: None Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: User-Agent: python-novaclient Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Auth-Token: gAAAAABjCQ4uUxa0kByIlP54zcXUziB3jjKsR7zozLviJC4bz-Qnyp3ngCERQQW5AZOy3twu-KOSshViHDavAZ_8e_jns7UlmgDqy25funtMyPVo_5BNlfJqqejlX2qH7Pec1AuHQa1DUnom2tKDRfU7CSMC9kmjSF0fOHeD3Yh8NgYiRp30DAo Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Domain-Id: None Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Domain-Name: None Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Identity-Status: Confirmed Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Is-Admin-Project: True Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Project-Domain-Id: default Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Project-Domain-Name: Default Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Project-Id: 8a44db81f3af4ce4ac409fec8e68c2cd Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Project-Name: admin Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Role: reader,member,admin Aug 26 18:17:19.260481 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Roles: reader,member,admin Aug 26 18:17:19.262061 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a44db81f3af4ce4ac409fec8e68c2cd", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a44db81f3af4ce4ac409fec8e68c2cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a44db81f3af4ce4ac409fec8e68c2cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a44db81f3af4ce4ac409fec8e68c2cd"}]}] Aug 26 18:17:19.262061 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Tenant: admin Aug 26 18:17:19.262061 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Tenant-Id: 8a44db81f3af4ce4ac409fec8e68c2cd Aug 26 18:17:19.262061 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-Tenant-Name: admin Aug 26 18:17:19.262061 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-User: admin Aug 26 18:17:19.262061 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-User-Domain-Id: default Aug 26 18:17:19.262061 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-User-Domain-Name: Default Aug 26 18:17:19.262061 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-User-Id: 5d269ce658414d469f0da1f990d74895 Aug 26 18:17:19.262061 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: X-User-Name: admin Aug 26 18:17:19.262061 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: method: > Aug 26 18:17:19.262061 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: exception: Flavor 451 could not be found. Aug 26 18:17:19.262061 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: action_args: {'id': '451'} Aug 26 18:17:19.262061 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:17:19.262061 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:17:19.263093 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: ERROR nova.api.openstack.wsgi Aug 26 18:17:19.264224 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-9bbcba6a-60a0-49c3-a604-065af7f26da6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:17:19.265291 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-9bbcba6a-60a0-49c3-a604-065af7f26da6 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.433717 Aug 26 18:17:19.265291 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Aug 26 18:17:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:19.271802 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-5e35e8cb-2979-448b-ae1a-a6886c97941a admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:19.287314 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-5e35e8cb-2979-448b-ae1a-a6886c97941a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019207 Aug 26 18:17:19.287824 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Aug 26 18:17:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:17:19.297509 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-1cc7a842-cfde-49f8-a072-f0700cbf8eab admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:19.312687 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-1cc7a842-cfde-49f8-a072-f0700cbf8eab admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018745 Aug 26 18:17:19.313252 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Aug 26 18:17:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:17:19.325630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-cd318933-abcc-4de1-a533-678f3d975756 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:19.331312 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.wsgi [None req-cd318933-abcc-4de1-a533-678f3d975756 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-cd318933-abcc-4de1-a533-678f3d975756 admin admin] Request method failure captured: Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Accept: application/json Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Accept-Encoding: gzip, deflate Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Connection: keep-alive Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Content-Length: 0 Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Host: 10.222.0.45 Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Openstack-Api-Version: compute 2.90 Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Openstack-System-Scope: None Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: User-Agent: python-novaclient Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Auth-Token: gAAAAABjCQ4uUxa0kByIlP54zcXUziB3jjKsR7zozLviJC4bz-Qnyp3ngCERQQW5AZOy3twu-KOSshViHDavAZ_8e_jns7UlmgDqy25funtMyPVo_5BNlfJqqejlX2qH7Pec1AuHQa1DUnom2tKDRfU7CSMC9kmjSF0fOHeD3Yh8NgYiRp30DAo Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Domain-Id: None Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Domain-Name: None Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Identity-Status: Confirmed Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Is-Admin-Project: True Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Project-Domain-Id: default Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Project-Domain-Name: Default Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Project-Id: 8a44db81f3af4ce4ac409fec8e68c2cd Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Project-Name: admin Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Role: reader,member,admin Aug 26 18:17:19.332853 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Roles: reader,member,admin Aug 26 18:17:19.334545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a44db81f3af4ce4ac409fec8e68c2cd", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a44db81f3af4ce4ac409fec8e68c2cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a44db81f3af4ce4ac409fec8e68c2cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a44db81f3af4ce4ac409fec8e68c2cd"}]}] Aug 26 18:17:19.334545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Tenant: admin Aug 26 18:17:19.334545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Tenant-Id: 8a44db81f3af4ce4ac409fec8e68c2cd Aug 26 18:17:19.334545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-Tenant-Name: admin Aug 26 18:17:19.334545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-User: admin Aug 26 18:17:19.334545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-User-Domain-Id: default Aug 26 18:17:19.334545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-User-Domain-Name: Default Aug 26 18:17:19.334545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-User-Id: 5d269ce658414d469f0da1f990d74895 Aug 26 18:17:19.334545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: X-User-Name: admin Aug 26 18:17:19.334545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: method: > Aug 26 18:17:19.334545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: exception: Flavor 451 could not be found. Aug 26 18:17:19.334545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: action_args: {'id': '451'} Aug 26 18:17:19.334545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:17:19.334545 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:17:19.335630 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: ERROR nova.api.openstack.wsgi Aug 26 18:17:19.336871 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-cd318933-abcc-4de1-a533-678f3d975756 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:17:19.338103 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-cd318933-abcc-4de1-a533-678f3d975756 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012416 Aug 26 18:17:19.338103 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Aug 26 18:17:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 18:17:20.297366 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-1cc7a842-cfde-49f8-a072-f0700cbf8eab admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:20.298371 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-1cc7a842-cfde-49f8-a072-f0700cbf8eab admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 26 18:17:20.298756 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Aug 26 18:17:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:17:20.841734 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-11364056-74fe-4331-b58c-d8be814a2c8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:17:20.862763 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-11364056-74fe-4331-b58c-d8be814a2c8e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.427100 Aug 26 18:17:20.863294 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Aug 26 18:17:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 18:17:21.834555 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-1cc7a842-cfde-49f8-a072-f0700cbf8eab admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:21.835600 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-1cc7a842-cfde-49f8-a072-f0700cbf8eab admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 26 18:17:21.836006 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Aug 26 18:17:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:17:22.395778 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-fe2d2f36-02e6-4f0e-84c0-f7614325a3b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:17:22.417346 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-fe2d2f36-02e6-4f0e-84c0-f7614325a3b3 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.444539 Aug 26 18:17:22.417934 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Aug 26 18:17:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:17:23.401868 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-1cc7a842-cfde-49f8-a072-f0700cbf8eab admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:23.402877 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-1cc7a842-cfde-49f8-a072-f0700cbf8eab admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 26 18:17:23.403297 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Aug 26 18:17:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:17:23.952565 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-e8828879-abdf-4b34-b891-57ec4c68106e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:17:23.976649 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-e8828879-abdf-4b34-b891-57ec4c68106e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.435583 Aug 26 18:17:23.977235 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Aug 26 18:17:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:17:25.121112 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-1cc7a842-cfde-49f8-a072-f0700cbf8eab admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:25.122145 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-1cc7a842-cfde-49f8-a072-f0700cbf8eab admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 26 18:17:25.122558 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Aug 26 18:17:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:17:25.683255 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-95c8abbb-c153-4436-b911-ffeaed7cb7f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:17:25.708182 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-95c8abbb-c153-4436-b911-ffeaed7cb7f6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.445048 Aug 26 18:17:25.708749 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Aug 26 18:17:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:17:26.692394 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-1cc7a842-cfde-49f8-a072-f0700cbf8eab admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:26.693663 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-1cc7a842-cfde-49f8-a072-f0700cbf8eab admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001817 Aug 26 18:17:26.694284 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Aug 26 18:17:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:17:27.229464 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-7863c738-cdbb-4f2a-9ce3-fe37baeca1ae admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:17:27.250174 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-7863c738-cdbb-4f2a-9ce3-fe37baeca1ae admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.419826 Aug 26 18:17:27.250723 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Fri Aug 26 18:17:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:18:20.709742 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-1cc7a842-cfde-49f8-a072-f0700cbf8eab admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:18:20.710759 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-1cc7a842-cfde-49f8-a072-f0700cbf8eab admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 26 18:18:20.711157 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 931 bytes} [Fri Aug 26 18:18:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:18:20.724964 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:21.144448 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-93e4e34b-f19f-4c5d-93d4-6b930d5a2f93 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:18:21.164682 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-93e4e34b-f19f-4c5d-93d4-6b930d5a2f93 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.446879 Aug 26 18:18:21.165300 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1292 bytes} [Fri Aug 26 18:18:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:18:21.187066 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG dbcounter [-] [105530] Writing DB stats nova_api:SELECT=14 {{(pid=105530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:18:21.192473 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-fe0b9a85-053d-4a41-9f97-eb99d3b585e2 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:18:21.202170 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-fe0b9a85-053d-4a41-9f97-eb99d3b585e2 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017517 Aug 26 18:18:21.202701 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1283 bytes} [Fri Aug 26 18:18:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:18:21.216916 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-0fde32cc-cdfc-447a-aa7d-67c6168df204 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:18:21.228038 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-0fde32cc-cdfc-447a-aa7d-67c6168df204 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017009 Aug 26 18:18:21.228598 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1286 bytes} [Fri Aug 26 18:18:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:18:21.240310 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-d8192ed9-4d29-42b8-a8b5-67a613e4eff5 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:18:21.248257 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-d8192ed9-4d29-42b8-a8b5-67a613e4eff5 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011549 Aug 26 18:18:21.248758 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1286 bytes} [Fri Aug 26 18:18:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:18:21.260142 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-a5f73276-64a7-4167-96f6-d8d7b59386fd admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:18:21.268111 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-a5f73276-64a7-4167-96f6-d8d7b59386fd admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011591 Aug 26 18:18:21.268677 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1283 bytes} [Fri Aug 26 18:18:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:21:30.753380 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-d8192ed9-4d29-42b8-a8b5-67a613e4eff5 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:21:30.754391 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-d8192ed9-4d29-42b8-a8b5-67a613e4eff5 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 26 18:21:30.755090 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Aug 26 18:21:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:21:30.900316 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_api:SELECT=6 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:21:31.074432 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-4bed3c19-7001-4297-a54f-40dfbce330d7 admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:21:31.078051 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-4bed3c19-7001-4297-a54f-40dfbce330d7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:21:31.078528 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-4bed3c19-7001-4297-a54f-40dfbce330d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:21:31.078973 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-4bed3c19-7001-4297-a54f-40dfbce330d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:21:31.079751 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-4bed3c19-7001-4297-a54f-40dfbce330d7 admin admin] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:21:31.080199 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-4bed3c19-7001-4297-a54f-40dfbce330d7 admin admin] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:21:31.080612 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-4bed3c19-7001-4297-a54f-40dfbce330d7 admin admin] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:21:31.114298 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-4bed3c19-7001-4297-a54f-40dfbce330d7 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.222309 Aug 26 18:21:31.114859 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Aug 26 18:21:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:21:31.939162 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-d8192ed9-4d29-42b8-a8b5-67a613e4eff5 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:21:31.940517 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-d8192ed9-4d29-42b8-a8b5-67a613e4eff5 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001974 Aug 26 18:21:31.941075 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Aug 26 18:21:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:21:32.142685 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-2f10be3f-b719-43d6-9c9b-637b9518e27c admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:21:32.146420 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-2f10be3f-b719-43d6-9c9b-637b9518e27c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:21:32.146900 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-2f10be3f-b719-43d6-9c9b-637b9518e27c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:21:32.147332 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-2f10be3f-b719-43d6-9c9b-637b9518e27c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:21:32.148086 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-2f10be3f-b719-43d6-9c9b-637b9518e27c admin admin] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:21:32.148543 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-2f10be3f-b719-43d6-9c9b-637b9518e27c admin admin] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:21:32.148987 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-2f10be3f-b719-43d6-9c9b-637b9518e27c admin admin] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:21:32.169752 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-2f10be3f-b719-43d6-9c9b-637b9518e27c admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.086327 Aug 26 18:21:32.170323 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Aug 26 18:21:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:21:43.424608 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-d8192ed9-4d29-42b8-a8b5-67a613e4eff5 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:21:43.426407 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-d8192ed9-4d29-42b8-a8b5-67a613e4eff5 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002298 Aug 26 18:21:43.427079 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 36/73] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Aug 26 18:21:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:21:43.578183 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_cell0:SELECT=4 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:21:43.578900 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_cell1:SELECT=4 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:21:43.579558 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG dbcounter [-] [105531] Writing DB stats nova_api:SELECT=8 {{(pid=105531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:21:43.629196 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-16bebd1b-016f-484b-8808-94874cb2178a admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:21:43.632985 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-16bebd1b-016f-484b-8808-94874cb2178a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:21:43.633455 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-16bebd1b-016f-484b-8808-94874cb2178a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:21:43.633878 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-16bebd1b-016f-484b-8808-94874cb2178a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:21:43.634580 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-16bebd1b-016f-484b-8808-94874cb2178a admin admin] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:21:43.635020 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-16bebd1b-016f-484b-8808-94874cb2178a admin admin] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:21:43.635432 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-16bebd1b-016f-484b-8808-94874cb2178a admin admin] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:21:43.660304 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-16bebd1b-016f-484b-8808-94874cb2178a admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086558 Aug 26 18:21:43.660900 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 38/74] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Aug 26 18:21:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:21:44.514852 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: DEBUG nova.api.openstack.wsgi [None req-d8192ed9-4d29-42b8-a8b5-67a613e4eff5 admin admin] Calling method '>' {{(pid=105530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:21:44.515882 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: INFO nova.api.openstack.requestlog [None req-d8192ed9-4d29-42b8-a8b5-67a613e4eff5 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 26 18:21:44.516438 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: [pid: 105530|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Aug 26 18:21:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:21:44.726344 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG nova.api.openstack.wsgi [None req-8a4f1d79-d9b1-4353-8ef7-83e20fdff4cf admin admin] Calling method '>' {{(pid=105531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:21:44.730181 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-8a4f1d79-d9b1-4353-8ef7-83e20fdff4cf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:21:44.730656 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-8a4f1d79-d9b1-4353-8ef7-83e20fdff4cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:21:44.731088 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-8a4f1d79-d9b1-4353-8ef7-83e20fdff4cf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:21:44.731863 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-8a4f1d79-d9b1-4353-8ef7-83e20fdff4cf admin admin] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:21:44.732547 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-8a4f1d79-d9b1-4353-8ef7-83e20fdff4cf admin admin] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:21:44.733015 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: DEBUG oslo_concurrency.lockutils [None req-8a4f1d79-d9b1-4353-8ef7-83e20fdff4cf admin admin] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:21:44.755365 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: INFO nova.api.openstack.requestlog [None req-8a4f1d79-d9b1-4353-8ef7-83e20fdff4cf admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.096893 Aug 26 18:21:44.756258 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: [pid: 105531|app: 0|req: 39/76] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Aug 26 18:21:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:22:43.695020 dv-cinder-851996-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 26 18:22:43.696524 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: Fri Aug 26 18:22:43 2022 - graceful shutdown triggered... Aug 26 18:22:43.697091 dv-cinder-851996-8-iscsi devstack@n-api.service[105530]: Gracefully killing worker 1 (pid: 105530)... Aug 26 18:22:43.697566 dv-cinder-851996-8-iscsi devstack@n-api.service[105531]: Gracefully killing worker 2 (pid: 105531)... Aug 26 18:22:44.697075 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: worker 1 buried after 1 seconds Aug 26 18:22:44.697075 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: worker 2 buried after 1 seconds Aug 26 18:22:44.697075 dv-cinder-851996-8-iscsi devstack@n-api.service[105529]: goodbye to uWSGI. Aug 26 18:22:44.699634 dv-cinder-851996-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 26 18:22:44.700534 dv-cinder-851996-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 26 18:22:44.705001 dv-cinder-851996-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 18:22:44.719014 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 18:22:44.721060 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 18:22:44 2022] *** Aug 26 18:22:44.721248 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 18:22:44.721383 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 18:22:44.721503 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: nodename: dv-cinder-851996-8-iscsi Aug 26 18:22:44.721624 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: machine: x86_64 Aug 26 18:22:44.721739 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: clock source: unix Aug 26 18:22:44.721947 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: pcre jit disabled Aug 26 18:22:44.721947 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: detected number of CPU cores: 4 Aug 26 18:22:44.721947 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: current working directory: / Aug 26 18:22:44.721947 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: detected binary path: /usr/bin/uwsgi-core Aug 26 18:22:44.721947 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: your processes number limit is 47680 Aug 26 18:22:44.721947 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: your memory page size is 4096 bytes Aug 26 18:22:44.721947 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: detected max file descriptor number: 2048 Aug 26 18:22:44.721947 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: lock engine: pthread robust mutexes Aug 26 18:22:44.722494 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: thunder lock: enabled Aug 26 18:22:44.722494 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 18:22:44.722494 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 18:22:44.765164 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: Python main interpreter initialized at 0x55e584d9b9c0 Aug 26 18:22:44.765164 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: python threads support enabled Aug 26 18:22:44.765164 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: your server socket listen backlog is limited to 100 connections Aug 26 18:22:44.765164 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: your mercy for graceful operations on workers is 90 seconds Aug 26 18:22:44.765638 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 18:22:44.765638 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: *** Operational MODE: preforking *** Aug 26 18:22:44.765919 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: *** uWSGI is running in multiple interpreter mode *** Aug 26 18:22:44.765919 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: spawned uWSGI master process (pid: 120521) Aug 26 18:22:44.766139 dv-cinder-851996-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 18:22:44.769129 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: spawned uWSGI worker 1 (pid: 120539, cores: 1) Aug 26 18:22:44.769129 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: spawned uWSGI worker 2 (pid: 120540, cores: 1) Aug 26 18:22:44.769129 dv-cinder-851996-8-iscsi devstack@n-api.service[120521]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 18:22:45.411878 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 18:22:45.426035 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 18:22:46.554605 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 18:22:46.554605 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: from cryptography.utils import int_from_bytes Aug 26 18:22:46.555205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 18:22:46.555205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: from cryptography.utils import int_from_bytes Aug 26 18:22:46.564314 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 18:22:46.564314 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: from cryptography.utils import int_from_bytes Aug 26 18:22:46.564816 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 18:22:46.564816 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: from cryptography.utils import int_from_bytes Aug 26 18:22:48.927905 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 18:22:48.928672 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 18:22:48.929348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 18:22:48.929488 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 18:22:48.929569 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 18:22:48.929647 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 18:22:48.929732 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 18:22:48.929835 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 18:22:48.929941 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 18:22:48.930021 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 18:22:48.930103 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.930103 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.930293 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.930380 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.930716 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.930825 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.930973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.931074 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.931355 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.931489 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.931702 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.932002 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.932134 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.932360 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.932451 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.932608 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.932808 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.932969 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.933127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.933323 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-8-iscsi {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.933487 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.933487 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.933785 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.933927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.934100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.934254 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-8-iscsi {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.934405 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.934553 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.934701 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.934848 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.935004 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.935153 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.935294 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.935448 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.935590 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.935749 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.935905 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.936078 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.936232 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.936379 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.936794 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.936975 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.937140 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.937291 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.937444 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.937592 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.937746 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.937894 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.938036 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.938183 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.938549 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.938769 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.938989 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.939196 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.939413 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.939413 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.939813 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.940042 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-8-iscsi {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.940259 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.940477 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.940702 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.940955 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.941173 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.941396 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.941609 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-8-iscsi {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.941821 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.942035 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.942259 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.942515 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.942752 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.942989 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.943230 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.943230 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.943618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.944051 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.944242 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.944242 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.944561 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.944561 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.944897 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.945051 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.945051 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.945342 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.945526 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.945681 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.945833 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.945833 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.946115 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.946268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.946417 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.946574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.947079 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.947241 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.947383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.947524 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.947687 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.947847 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.948034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.948190 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.948335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.948488 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.948488 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.948488 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.949009 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.949178 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.949335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.949550 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.949717 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.949873 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.950024 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.950167 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.950167 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.950449 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.950605 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.950754 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.950896 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.951044 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.951185 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.951185 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.951479 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.951639 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.951792 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.951952 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.952094 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.952245 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.952395 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.952545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.952545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.952858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.953004 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.953170 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.953313 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.953455 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.953602 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.953752 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.953893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.954044 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.954193 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.954334 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.954474 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.954621 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.954771 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.954915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.955077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.955228 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.955378 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.955528 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.955678 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.955819 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.955967 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.956109 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.956249 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.956399 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.956555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.956704 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.956916 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.956916 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.957311 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.957311 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.957587 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.957736 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.957877 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.957877 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.958152 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.958305 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.958446 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.958593 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.958734 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.958882 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.959041 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.959199 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.959341 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.959489 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.959636 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.959777 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.959917 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.960065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.960207 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.960348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.960488 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.960636 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.960824 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.960986 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.961135 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.961135 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.961408 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.961562 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.961705 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.961858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.962011 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.962162 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.962303 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.962455 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.962613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.962773 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.962922 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.963070 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.963219 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.963360 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.963515 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.963664 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.963813 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.963964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.964113 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.964254 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.964403 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.964552 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.964711 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.964907 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.965059 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.965201 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.965347 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.965489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.965635 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.965790 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.965932 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.966079 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.966220 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.966368 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.966518 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.966678 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.966827 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.966968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.967115 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.967279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.967435 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.967577 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.967719 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.967868 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.968010 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.968212 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.968358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.968499 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.968659 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.968839 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.968992 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.969133 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.969274 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.969423 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.969564 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.969719 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.969868 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.970017 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.970159 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.970305 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.970458 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.970615 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.970758 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.970898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.971044 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.971185 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.971340 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.971491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.971640 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.971790 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.971938 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.972085 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.972236 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.972396 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.972538 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.972678 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.972863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.973008 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.973158 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.973311 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.973454 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.973595 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.973746 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.973895 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.974123 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.974274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.974435 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.974585 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.974734 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.974884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.975033 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.975175 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.975322 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.975464 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.975603 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.975752 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.975899 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.976049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.976201 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.976341 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 18:22:48.977381 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.977752 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.977917 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.978016 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.978099 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.978172 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.978250 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.978329 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.978411 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.978482 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.978553 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.978627 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.978706 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.979055 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.979185 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.979302 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.979400 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.979473 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.979557 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.979656 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.979736 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.979806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.979874 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.979942 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.980009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.980086 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.980157 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.980225 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.980293 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.980367 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.980444 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.980526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.980598 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.980672 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.980808 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.981022 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.981313 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.981465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.981645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.981782 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.981955 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.982092 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.982268 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.982418 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.982598 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.982733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.982916 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.983051 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.983200 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.983304 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.983547 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.983692 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.983862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.984012 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.984143 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.984252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.984485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.984634 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.984787 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.984945 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.985121 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.985271 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.985383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.985476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.985717 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.985874 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.986030 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.986134 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.986348 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.986443 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.986655 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.986758 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.986973 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.987064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.987268 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.987458 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.987657 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.987819 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.987966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.988119 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.988262 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.988410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.988562 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.988730 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.988880 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.989022 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.989163 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.989336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.989505 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.989669 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.989821 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.989963 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.990103 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.990243 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.990393 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.990544 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.990694 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.990842 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.991010 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.991160 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.991321 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.991464 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.991604 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.991753 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.991902 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.992044 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.992194 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.992335 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.992475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.992623 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.992823 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.992973 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.993132 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.993294 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.993469 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.993627 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.993769 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.993922 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.994064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.994212 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.994362 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.994511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.994662 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.994819 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.994961 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.995112 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.995272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.995415 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.995571 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.995728 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.995879 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.996022 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.996165 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.996320 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.996463 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.996613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.996772 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.996930 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.997094 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.997244 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.997403 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.997560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.997710 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.997710 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.997987 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.998129 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.998279 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.998427 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.998567 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.998708 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.998854 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.999012 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.999234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.999389 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.999538 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.999687 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.999829 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:48.999970 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.000130 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.000281 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.000424 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.000575 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.000820 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.000985 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.001143 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.001295 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.001450 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.001601 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.001742 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.001892 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.002033 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.002182 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.002333 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.002481 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.002630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.002780 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.002932 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.003092 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.003236 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.003384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.003525 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.003673 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.003822 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.003971 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.004112 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.004254 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.004409 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.004551 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.004699 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.004874 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.005017 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.005167 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.005323 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.005473 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.005623 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.005765 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.005912 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.006053 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.006208 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.006349 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.006490 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.006638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.006791 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.006944 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.007096 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.007239 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.007398 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.007543 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.007692 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.007849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.007992 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.008139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.008289 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.008769 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.008921 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.009136 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.009288 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.009430 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.009579 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.009721 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.009868 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.010019 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.010161 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.010308 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.010450 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.010602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.010744 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.010899 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.011053 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.011204 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.011346 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.011494 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.011645 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.011787 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.011974 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.012123 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.012302 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.012459 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.012616 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.012809 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.012966 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.013126 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.013276 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.013417 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.013566 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.013715 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.013856 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.013998 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.014147 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.014298 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.014448 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.014590 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.014737 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.014891 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.015057 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.015215 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.015372 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.015722 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.015926 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.016257 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.016414 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.016567 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.016909 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.017048 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.017410 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.017735 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.018006 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.018177 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.018392 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.018571 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.019281 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.019443 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.019575 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.019720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.019893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.020024 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.020194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.020194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.020461 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.020604 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.020756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.020887 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.021013 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.021153 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.021291 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.021522 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.021657 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.021855 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.022004 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.022172 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.022423 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.022557 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.022783 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.022913 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.023104 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.023341 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.023483 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.023714 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.023855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.024025 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.024242 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.024374 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.024654 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.024944 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.025082 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.025247 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.025474 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.025607 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.025749 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.025948 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.026079 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.026262 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.026477 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.026618 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.026894 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.027330 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.027799 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.027986 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.028117 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.028254 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.028384 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.028604 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.028757 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.028757 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.029005 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.029147 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.029284 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.029412 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.029412 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.029842 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.029991 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.030135 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.030264 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.030399 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.030536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.030664 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.030878 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.031226 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.031366 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.031536 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.031698 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.031847 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.032146 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.032326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.032456 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.032617 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.032822 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.033061 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.033203 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.033379 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.033543 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.033696 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.033962 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.034104 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.034307 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.034437 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.034621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.034860 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.035008 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.035285 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.035526 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.035703 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.035868 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.036124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.036271 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.036495 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.036624 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.036854 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.037082 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.037746 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.037999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.038188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.038319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.038461 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.038697 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.038840 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.038840 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.039101 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.039229 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.039365 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.039494 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.039494 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.039743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.039870 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.039998 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.040142 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.040271 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.040553 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.040745 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.040880 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.041167 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.041301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.041486 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.041660 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.041802 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.042111 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.042262 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.042392 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.042560 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.042692 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.042984 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.043117 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.043290 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.043477 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.043632 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.043862 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.043993 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.044212 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.044352 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.044522 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.044792 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.044929 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.045232 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.045404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.045543 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.045672 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.045832 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.046072 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.046204 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.046501 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.046633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.046808 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.046983 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.047124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.047542 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.048011 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.048197 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.048197 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.048454 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.048583 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.048829 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.048988 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.049128 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.049257 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.049393 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.049528 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.049667 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.049893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.050022 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.050220 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.050432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.050566 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.050808 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.050962 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.051120 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.051406 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.051553 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.051729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.051859 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.052046 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.052351 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.052491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.052657 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.052854 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.052993 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.053273 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.053411 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.053586 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.053763 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.053894 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.054181 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.054322 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.054497 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.054638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.054806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.055053 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.055185 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.055403 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.055533 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.055715 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.055976 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.056119 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.056342 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.056479 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.056661 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.056888 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.057021 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.057291 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.057945 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.058222 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.058367 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.058498 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.058634 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.058769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.059025 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.059161 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.059161 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.059418 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.059546 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.059681 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.059816 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.059816 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.060075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.060219 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.060348 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.060484 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.060613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.060789 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.060930 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.061182 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.061322 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.061488 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.061686 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.061827 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.062092 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.062229 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.062395 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.062596 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.062735 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.063013 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.063149 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.063322 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.063531 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.063670 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.063922 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.064062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.064225 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.064398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.064573 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.064861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.065086 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.065253 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.065392 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.065561 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.065740 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.065881 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.066157 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.066299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.066486 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.066615 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.066798 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.067035 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.067191 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.067406 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.068023 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.068161 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.068437 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.068569 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.068707 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.068871 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.069107 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.069252 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.069252 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.069516 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.069653 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.069789 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.069925 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.069925 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.070176 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.070320 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.070449 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.070590 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.070779 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.070916 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.071086 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.071293 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.071435 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.071778 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.071921 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.072092 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.072260 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.072434 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.072747 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.072883 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.073074 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.073251 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.073928 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.074155 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.074301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.074440 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.074579 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.074708 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.074850 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.074850 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.075111 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.075239 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.075366 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.075501 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.075501 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.075762 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.075890 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.076098 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.076234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.076404 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.076577 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.076710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.077015 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.077148 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.077356 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.077501 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.078083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.078305 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.078477 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.078605 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.078733 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.078875 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.079549 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.079682 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.079819 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.079949 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.080076 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.080076 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.080333 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.080468 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.080604 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.080795 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.080795 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.081068 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.081205 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.081334 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.081469 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.081597 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.081739 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.081877 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.082070 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.082202 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.082411 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.082542 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.082725 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.082942 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.083082 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.083351 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.083489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.083660 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.083828 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.084570 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.084709 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.084881 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.085014 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.085143 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.085285 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.085414 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.085414 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.085670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.085807 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.085950 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.086082 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.086306 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.086437 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.086647 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.086779 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.086962 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.087352 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.087496 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.087635 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.087782 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.088320 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.088581 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.088743 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.088888 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.089025 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.089153 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.089282 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.089282 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.089731 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.089864 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.089993 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.090120 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.090120 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.090380 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.090509 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.090700 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.090839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.091046 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.091185 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.091366 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.091582 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.091715 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.092002 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.092133 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.092417 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.092549 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.092761 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.092898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.093084 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.093320 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.093468 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.093709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.093842 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.094018 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.094200 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.094340 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.094619 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.094751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.094929 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.095065 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.095255 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.095512 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.095646 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.095863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.095993 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.096176 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.096389 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.096537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.096928 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.097072 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.097215 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.097345 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.097565 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.097708 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.097844 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.098188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.098470 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.098470 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.098845 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.098991 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.099127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.099262 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.099399 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.099526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.099678 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.099971 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.100102 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.100272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.100405 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.100578 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.100782 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.100914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.101180 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.101325 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.101543 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.101674 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.101875 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.102056 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.102212 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.102493 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.103184 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.103184 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.103440 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.103576 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.103706 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.103841 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.103981 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.104118 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.104246 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.104374 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.104501 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.104694 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.104883 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.105121 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.105269 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.105529 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.105673 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.105812 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.105998 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.106139 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.106322 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.106453 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.106635 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.106880 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.107026 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.107231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.107370 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.107609 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.107865 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.108011 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.108356 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.108806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.108957 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.109095 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.109226 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.109368 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.109497 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.109497 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.109738 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.109888 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.110213 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.110345 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.110345 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.110603 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.110732 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.110928 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.111070 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.111255 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.111391 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.111574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.111899 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.112029 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.112217 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.112359 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.112534 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.112831 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.112969 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.113183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.113333 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.113500 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.113668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.113806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.114098 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.114246 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.114423 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.114561 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.114744 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.114994 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.115312 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.115455 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.115647 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.115809 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.115962 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.116226 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.116357 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.116578 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.116730 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.116921 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.117147 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.117280 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.117540 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.117698 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.117901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.118146 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.118293 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.118840 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.119061 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.119203 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.119332 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.119460 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.119460 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.119712 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.119849 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.120007 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.120365 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.120365 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.120621 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.120790 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.120932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.121062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.121346 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.121478 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.121668 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.121833 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.121974 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.122252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.122384 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.122588 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.122797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.122940 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.123199 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.123338 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.123512 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.123702 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.123836 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.124132 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.124263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.124448 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.124601 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.124792 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.125054 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.125197 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.125395 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.125535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.125725 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.125955 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.126099 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.126408 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.126556 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.126692 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.126857 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.126998 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.127296 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.127429 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.129293 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.129464 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.129609 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.129751 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.129751 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.130068 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.130222 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.130446 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.130672 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.130815 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.130815 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.131071 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.131210 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.131341 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.131471 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.131471 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.131723 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.131860 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.131995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.132124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.132124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.132411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.132541 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.132690 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.132972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.132972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.133273 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.133775 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.133916 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.134066 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.134066 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.134332 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.134332 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.135089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.135089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.135896 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.136029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.136166 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.136310 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.136426 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.136545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.136666 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.136817 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.136932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.137057 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.137176 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.137286 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.137286 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.137286 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.137603 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.137721 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.137839 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.137950 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.138084 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.138203 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.138323 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.138434 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.138563 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.138740 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.138869 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.139481 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.139630 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.139754 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.139865 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.139985 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.140097 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.140237 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.140365 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.140476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.140595 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.140756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.140972 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.141189 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.141393 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.141517 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.141650 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.141761 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.141870 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.141989 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.142111 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.142231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.142350 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.142461 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.142661 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.142800 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.142976 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.143095 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.143283 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.143457 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.143600 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.143830 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.143972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.144100 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.144212 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.144321 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.144482 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.144620 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.144817 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.144938 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.145150 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.145302 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.145533 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.145667 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.145780 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.145903 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.146015 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.146124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.146339 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.146477 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.146642 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.146803 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.146964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.147092 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.147272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.147399 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.147576 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.147694 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.147882 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.148083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.148205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.148316 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.148515 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.149586 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.149819 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.149988 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.150137 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.150289 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.150440 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.150584 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.150726 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.150726 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.151133 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.151284 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.151450 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.151450 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.151819 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.151972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.152117 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.152261 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.152403 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.152403 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.152687 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.152876 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.153031 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.153175 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.153337 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.153483 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.153641 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.153792 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.153944 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.154095 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.154241 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.154241 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.154521 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.154665 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.154817 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.154962 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.155113 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.155267 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.155411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.155553 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.155702 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.155845 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.155994 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.156146 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.156289 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.156432 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.156575 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.156759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.156930 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.157090 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.157241 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.157387 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.157530 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.157672 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.157824 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.157968 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.158110 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.158261 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.158404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.158558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.158710 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.158856 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.159006 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.159165 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.159803 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.159967 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.160134 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.160290 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.160434 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.160586 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.160751 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.160940 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.161094 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.161342 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.161507 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.161678 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.161913 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.162072 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.162225 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.162388 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.162541 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.162687 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.162830 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.162992 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.163145 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.163289 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.163431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.163581 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.163741 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.163886 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.164036 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.164189 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.164342 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.164485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.164637 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.165353 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.165526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.165526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.165821 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.165966 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.166120 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.166265 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.166416 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.166567 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.166726 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.166881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.167025 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.167174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.167330 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.167330 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.167609 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.167762 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.167907 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.168050 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.168193 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.168335 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.168476 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.168631 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.168828 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.168988 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.169134 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.169291 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.169937 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.170101 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.170247 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.170391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.170534 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.170685 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.170851 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.171010 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.171164 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.171309 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.171561 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.171720 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.171875 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.172122 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.172280 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.172436 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.172588 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.172823 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.172993 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.173140 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.173284 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.173434 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.173586 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.173745 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.173745 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.174037 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.174189 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.174340 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.174483 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.174640 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.174791 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.174943 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.175094 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.175239 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.175381 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.175533 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.175684 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.175838 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.175983 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.176133 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.176277 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.176429 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.176612 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.176777 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.176936 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.177080 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.177233 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.177379 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.177537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.177691 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.177840 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.177984 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.178136 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.178289 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.178434 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.178584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.178734 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.178885 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.179112 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.179258 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.179405 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.180053 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.180224 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.180389 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.180546 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.180699 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.180873 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.181068 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.181215 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.181371 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.181371 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.181766 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.181916 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.182059 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.182296 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.182468 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.182615 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.182758 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.182909 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.183062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.183205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.183362 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.183506 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.183662 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.183806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.183958 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.184120 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.184276 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.184419 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.184571 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.184731 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.184881 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.185042 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.185195 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.185340 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.185483 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.185633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.185779 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.185935 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.186087 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.186836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.186988 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.187134 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.187279 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.187422 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.187564 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.187716 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.187868 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.188050 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.188195 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.188345 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.188500 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.188658 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.188902 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.189050 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.189193 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.189337 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.189489 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.190771 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.190965 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.191115 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.191260 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.191404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.191572 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.191718 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.191986 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.192136 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.192307 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.192563 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.192745 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.192908 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.193063 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 18:22:49.193215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.193215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.193215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.193215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.193215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.193215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.193215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.193215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.194319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.194319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.194319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.194319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.194319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.194319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.194319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.194319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.195413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.195413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.195413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.195413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.195413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.195413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.195413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.195413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.196486 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.196486 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.196486 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.196486 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.196486 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.197234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.197234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.197554 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.197873 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.198181 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.198500 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.198818 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.199127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.199712 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.200205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.200367 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.200887 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.201512 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.201847 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.202153 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.202459 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.202765 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.203074 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.203391 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.203703 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.204008 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.204925 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.204925 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.204925 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.205444 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.205554 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.205826 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.206134 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.206435 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.206737 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.207039 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.207341 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.207643 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.207944 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.208249 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.208550 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.208878 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.209182 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.209485 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.209786 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.210119 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.210452 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.210767 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.211093 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.211399 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.211719 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.212026 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.212456 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.212802 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.213127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.213438 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.213771 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.214082 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.214390 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.214695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.215004 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.215314 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.215620 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.215946 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.216268 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.216569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.216924 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.217243 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.217560 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.217872 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.218179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.218506 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.218813 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.219118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.219425 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.219733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.220034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.220389 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.220645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.221221 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.221538 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.221854 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.222182 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.222935 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.222935 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.223185 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.223482 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.223834 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.224146 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.224488 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.224837 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.225181 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.225487 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.225786 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 18:22:49.226027 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 18:22:49.249866 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO dbcounter [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] Registered counter for database nova_api Aug 26 18:22:49.271438 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_db.sqlalchemy.engines [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:22:49.278647 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writer thread running {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:22:49.288099 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO dbcounter [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] Registered counter for database nova_api Aug 26 18:22:49.308346 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_db.sqlalchemy.engines [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:22:49.315352 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writer thread running {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:22:49.334161 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.context [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b13be996-0005-4abd-8d43-d4c756a0aa08(cell1) {{(pid=120539) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 18:22:49.338228 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:22:49.338703 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:22:49.340296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:22:49.341059 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:22:49.341507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:22:49.343510 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:22:49.345557 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO dbcounter [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] Registered counter for database nova_cell0 Aug 26 18:22:49.349578 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO dbcounter [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] Registered counter for database nova_cell1 Aug 26 18:22:49.357046 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_db.sqlalchemy.engines [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:22:49.358786 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_db.sqlalchemy.engines [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:22:49.364892 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writer thread running {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:22:49.366514 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writer thread running {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:22:49.370327 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.context [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b13be996-0005-4abd-8d43-d4c756a0aa08(cell1) {{(pid=120540) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 18:22:49.374373 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:22:49.374833 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:22:49.376411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:22:49.377165 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:22:49.377603 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:22:49.379571 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:22:49.381614 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO dbcounter [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] Registered counter for database nova_cell0 Aug 26 18:22:49.385994 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO dbcounter [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] Registered counter for database nova_cell1 Aug 26 18:22:49.393768 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_db.sqlalchemy.engines [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:22:49.394415 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_db.sqlalchemy.engines [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:22:49.399939 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writer thread running {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:22:49.402460 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writer thread running {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:22:49.513403 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO dbcounter [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] Registered counter for database nova_cell0 Aug 26 18:22:49.520571 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_db.sqlalchemy.engines [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:22:49.526013 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writer thread running {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:22:49.554357 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO dbcounter [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] Registered counter for database nova_cell0 Aug 26 18:22:49.563296 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_db.sqlalchemy.engines [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 18:22:49.568102 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writer thread running {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 18:22:49.840836 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: WARNING keystonemiddleware.auth_token [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 18:22:49.848103 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: WARNING keystonemiddleware.auth_token [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 18:22:49.875909 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: WARNING keystonemiddleware.auth_token [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 18:22:49.883207 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: WARNING keystonemiddleware.auth_token [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 18:22:50.187893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: WARNING keystonemiddleware.auth_token [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 18:22:50.193932 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: WARNING keystonemiddleware.auth_token [None req-2a28f3d1-e9c9-4ad5-8547-e60ba61dfc00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 18:22:50.199286 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e584d9b9c0 pid: 120539 (default app) Aug 26 18:22:50.221798 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: WARNING keystonemiddleware.auth_token [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 18:22:50.227779 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: WARNING keystonemiddleware.auth_token [None req-35ebbd00-30c1-4250-ab01-6c605370b6c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 18:22:50.233091 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e584d9b9c0 pid: 120540 (default app) Aug 26 18:23:24.521848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:24.523624 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:24.524592 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:24.525648 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:25.696214 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4f75725d-bb26-4fe5-babe-67392bb17841 tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] Action: 'create', calling method: .version_select at 0x7fc74525e940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-171642123", "metadata": {"Type": "work"}}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:23:26.877947 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=3 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:26.877947 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=3 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:26.877947 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=3 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:26.877947 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=3 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:28.379361 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4f75725d-bb26-4fe5-babe-67392bb17841 tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.872182 Aug 26 18:23:28.380432 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1156 bytes} [Fri Aug 26 18:23:24 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3875 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 26 18:23:28.395856 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2e1a5a02-6401-406a-a0d9-c3fe456034be tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] Calling method '.version_select at 0x7fc745066e50>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:28.527510 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-73ef910f-c6a8-47df-a341-8c281f122d43 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Action: 'create', calling method: .version_select at 0x7fc7451de940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1946356354"}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:23:28.585845 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2e1a5a02-6401-406a-a0d9-c3fe456034be tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ab726165-8f8d-427a-bd0a-2fef7b83fbad" status: 200 len: 352 microversion: 2.1 time: 0.194196 Aug 26 18:23:28.587297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2/2] 10.222.0.45 () {58 vars in 1245 bytes} [Fri Aug 26 18:23:28 2022] GET /compute/v2.1/os-volumes/ab726165-8f8d-427a-bd0a-2fef7b83fbad => generated 352 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:23:29.601753 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f6a3375e-99da-426d-b424-1a07d0b0f005 tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] Calling method '.version_select at 0x7fc74507b550>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:29.716933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f6a3375e-99da-426d-b424-1a07d0b0f005 tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ab726165-8f8d-427a-bd0a-2fef7b83fbad" status: 200 len: 353 microversion: 2.1 time: 0.119936 Aug 26 18:23:29.718399 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 3/3] 10.222.0.45 () {58 vars in 1245 bytes} [Fri Aug 26 18:23:29 2022] GET /compute/v2.1/os-volumes/ab726165-8f8d-427a-bd0a-2fef7b83fbad => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:23:29.731539 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3cbdb5cf-bc64-4664-aaf6-c25b36eb9baa tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] Calling method '.version_select at 0x7fc74507bc10>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:29.827551 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3cbdb5cf-bc64-4664-aaf6-c25b36eb9baa tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ab726165-8f8d-427a-bd0a-2fef7b83fbad" status: 200 len: 353 microversion: 2.1 time: 0.099764 Aug 26 18:23:29.828685 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 4/4] 10.222.0.45 () {58 vars in 1245 bytes} [Fri Aug 26 18:23:29 2022] GET /compute/v2.1/os-volumes/ab726165-8f8d-427a-bd0a-2fef7b83fbad => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:23:29.860142 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ffb2075d-e213-442e-8c0d-2d4d25a244e3 tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] Calling method '.version_select at 0x7fc74507bb80>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:30.018762 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ffb2075d-e213-442e-8c0d-2d4d25a244e3 tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/ab726165-8f8d-427a-bd0a-2fef7b83fbad" status: 202 len: 0 microversion: 2.1 time: 0.174144 Aug 26 18:23:30.019971 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 5/5] 10.222.0.45 () {58 vars in 1248 bytes} [Fri Aug 26 18:23:29 2022] DELETE /compute/v2.1/os-volumes/ab726165-8f8d-427a-bd0a-2fef7b83fbad => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:23:30.028245 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8e18580d-f336-4e5d-877a-09bc95018cd7 tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] Calling method '.version_select at 0x7fc74507b4c0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:30.138171 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8e18580d-f336-4e5d-877a-09bc95018cd7 tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ab726165-8f8d-427a-bd0a-2fef7b83fbad" status: 200 len: 352 microversion: 2.1 time: 0.114151 Aug 26 18:23:30.138855 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 6/6] 10.222.0.45 () {58 vars in 1245 bytes} [Fri Aug 26 18:23:30 2022] GET /compute/v2.1/os-volumes/ab726165-8f8d-427a-bd0a-2fef7b83fbad => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:23:30.377540 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-73ef910f-c6a8-47df-a341-8c281f122d43 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.547708 Aug 26 18:23:30.391860 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 1/7] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Aug 26 18:23:26 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3564 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 26 18:23:30.397183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-55187332-7b4b-4978-90a3-633fb764e222 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc745066ee0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:30.615381 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-55187332-7b4b-4978-90a3-633fb764e222 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc" status: 200 len: 345 microversion: 2.1 time: 0.224744 Aug 26 18:23:30.615961 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 7/8] 10.222.0.45 () {58 vars in 1245 bytes} [Fri Aug 26 18:23:30 2022] GET /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc => generated 345 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:23:31.155954 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-23f987c6-da2a-47d3-9540-daf13e0d789f tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] Calling method '.version_select at 0x7fc745061e50>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:31.543324 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-23f987c6-da2a-47d3-9540-daf13e0d789f tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] HTTP exception thrown: Volume ab726165-8f8d-427a-bd0a-2fef7b83fbad could not be found. Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-23f987c6-da2a-47d3-9540-daf13e0d789f tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] Request method failure captured: Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/os-volumes/ab726165-8f8d-427a-bd0a-2fef7b83fbad HTTP/1.1 Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ-cHF4uI3MHR8cJC7xvhgzVaJBy7vDe040_7CojVg2uravj_z0kd_3lXL4hx2He85nVA7YT8QUlPPJYBkQESJX3I-NBvRgSzP00YqVB2Tu2vzWqX8m9Qgytyg1iq0zV7cAwS0fd1_YJ3aa9CXjFx0AYxW1fcZPfvHkGuauIVudnXHw Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: e80ad22c76dc477aaa450d15738dc301 Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-VolumesGetTestJSON-1741066631 Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:23:31.547881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:23:31.549292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e80ad22c76dc477aaa450d15738dc301", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e80ad22c76dc477aaa450d15738dc301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e80ad22c76dc477aaa450d15738dc301"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e80ad22c76dc477aaa450d15738dc301"}]}] Aug 26 18:23:31.549292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-VolumesGetTestJSON-1741066631 Aug 26 18:23:31.549292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: e80ad22c76dc477aaa450d15738dc301 Aug 26 18:23:31.549292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-VolumesGetTestJSON-1741066631 Aug 26 18:23:31.549292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-VolumesGetTestJSON-1741066631-project Aug 26 18:23:31.549292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:23:31.549292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:23:31.549292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: 743d108dcfd844dc8225bb7fd701b00a Aug 26 18:23:31.549292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-VolumesGetTestJSON-1741066631-project Aug 26 18:23:31.549292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: Aug 26 18:23:31.549292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Volume ab726165-8f8d-427a-bd0a-2fef7b83fbad could not be found. Aug 26 18:23:31.549292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': 'ab726165-8f8d-427a-bd0a-2fef7b83fbad'} Aug 26 18:23:31.549292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab726165-8f8d-427a-bd0a-2fef7b83fbad could not be found. (HTTP 404) (Request-ID: req-28b2a7a0-f7c4-4f01-b550-237f3dff2229) Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:23:31.549953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 18:23:31.550940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab726165-8f8d-427a-bd0a-2fef7b83fbad could not be found. Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 18:23:31.551927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:23:31.553274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab726165-8f8d-427a-bd0a-2fef7b83fbad could not be found. Aug 26 18:23:31.553274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:31.553274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:23:31.553274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:31.553274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:31.553274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:23:31.553274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:23:31.553274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:23:31.553274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:23:31.553274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab726165-8f8d-427a-bd0a-2fef7b83fbad could not be found. Aug 26 18:23:31.553274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:31.555127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-23f987c6-da2a-47d3-9540-daf13e0d789f tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] Returning 404 to user: Volume ab726165-8f8d-427a-bd0a-2fef7b83fbad could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:23:31.556115 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-23f987c6-da2a-47d3-9540-daf13e0d789f tempest-VolumesGetTestJSON-1741066631 tempest-VolumesGetTestJSON-1741066631-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ab726165-8f8d-427a-bd0a-2fef7b83fbad" status: 404 len: 109 microversion: 2.1 time: 0.407492 Aug 26 18:23:31.557879 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 2/9] 10.222.0.45 () {58 vars in 1245 bytes} [Fri Aug 26 18:23:31 2022] GET /compute/v2.1/os-volumes/ab726165-8f8d-427a-bd0a-2fef7b83fbad => generated 109 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:23:31.630824 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-07607a32-d5dc-466d-b151-a653f182de04 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc745066f70>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:31.807708 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-07607a32-d5dc-466d-b151-a653f182de04 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc" status: 200 len: 346 microversion: 2.1 time: 0.181830 Aug 26 18:23:31.808794 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 8/10] 10.222.0.45 () {58 vars in 1245 bytes} [Fri Aug 26 18:23:31 2022] GET /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc => generated 346 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:23:31.828922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-daf8cf2b-bc7d-48b2-8b48-85edb4c2155f tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Action: 'create', calling method: .version_select at 0x7fc7459e5550>, body: {"snapshot": {"volume_id": "44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-890928757"}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:23:32.313320 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-daf8cf2b-bc7d-48b2-8b48-85edb4c2155f tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.492033 Aug 26 18:23:32.314148 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 3/11] 10.222.0.45 () {60 vars in 1162 bytes} [Fri Aug 26 18:23:31 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:23:32.327435 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5d47fc5e-31de-4002-b8da-6bfe94318bdd tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc74507b4c0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:32.451951 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5d47fc5e-31de-4002-b8da-6bfe94318bdd tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213" status: 200 len: 286 microversion: 2.1 time: 0.129951 Aug 26 18:23:32.452589 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 9/12] 10.222.0.45 () {58 vars in 1251 bytes} [Fri Aug 26 18:23:32 2022] GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:23:32.468623 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-313edac8-e7b7-49f5-8596-d4e12b9e891f tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc744fc2f70>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:32.558742 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-313edac8-e7b7-49f5-8596-d4e12b9e891f tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.094183 Aug 26 18:23:32.576021 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 4/13] 10.222.0.45 () {58 vars in 1140 bytes} [Fri Aug 26 18:23:32 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:23:32.582822 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3a960749-f4d7-42c7-a1f5-04c931e7fa21 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc74507bca0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:32.653272 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3a960749-f4d7-42c7-a1f5-04c931e7fa21 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213" status: 200 len: 286 microversion: 2.1 time: 0.084131 Aug 26 18:23:32.660073 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 10/14] 10.222.0.45 () {58 vars in 1251 bytes} [Fri Aug 26 18:23:32 2022] GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213 => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:23:33.666162 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7a684d81-19cd-4d44-be0f-499350a4f5e3 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc744fe7280>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:33.719416 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-7a684d81-19cd-4d44-be0f-499350a4f5e3 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213" status: 200 len: 286 microversion: 2.1 time: 0.057415 Aug 26 18:23:33.720354 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 5/15] 10.222.0.45 () {58 vars in 1251 bytes} [Fri Aug 26 18:23:33 2022] GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:23:34.736117 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cc9e453b-60fb-4a3b-aef2-fc04cc59f69a tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc74507baf0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:34.830737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cc9e453b-60fb-4a3b-aef2-fc04cc59f69a tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213" status: 200 len: 286 microversion: 2.1 time: 0.100827 Aug 26 18:23:34.840526 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 11/16] 10.222.0.45 () {58 vars in 1251 bytes} [Fri Aug 26 18:23:34 2022] GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213 => generated 286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:23:35.575653 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-285994937", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "networks": [{"uuid": "dbacf43a-039b-44c2-bd25-faab4bae8f96"}]}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:23:35.810788 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.network.neutron [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] validate_networks() for [('dbacf43a-039b-44c2-bd25-faab4bae8f96', None, None, None, None, None)] {{(pid=120540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:23:35.846361 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-069be203-e0c6-4ca9-b587-aebc2aa3b293 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc74507b310>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:35.895542 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-069be203-e0c6-4ca9-b587-aebc2aa3b293 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213" status: 200 len: 287 microversion: 2.1 time: 0.054742 Aug 26 18:23:35.896439 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 12/17] 10.222.0.45 () {58 vars in 1251 bytes} [Fri Aug 26 18:23:35 2022] GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:23:35.908150 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a69ac160-83aa-42f7-9898-546e53926188 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc745066d30>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:36.068528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a69ac160-83aa-42f7-9898-546e53926188 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213" status: 202 len: 0 microversion: 2.1 time: 0.158314 Aug 26 18:23:36.071731 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 13/18] 10.222.0.45 () {58 vars in 1254 bytes} [Fri Aug 26 18:23:35 2022] DELETE /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 18:23:36.080970 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e0d930fb-8036-4162-a772-4d4de2046386 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc745002550>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:36.139867 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e0d930fb-8036-4162-a772-4d4de2046386 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213" status: 200 len: 286 microversion: 2.1 time: 0.063603 Aug 26 18:23:36.142220 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 14/19] 10.222.0.45 () {58 vars in 1251 bytes} [Fri Aug 26 18:23:36 2022] GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:23:37.154190 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0a573e50-c8dc-444f-bce0-2f859dea47df tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc745066f70>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:37.238585 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0a573e50-c8dc-444f-bce0-2f859dea47df tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213" status: 200 len: 286 microversion: 2.1 time: 0.088377 Aug 26 18:23:37.240796 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 15/20] 10.222.0.45 () {58 vars in 1251 bytes} [Fri Aug 26 18:23:37 2022] GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213 => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:23:37.701746 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Flavor limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:23:37.702296 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Image limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:23:37.703061 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Flavor pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:23:37.703459 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Image pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:23:37.703973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:23:37.740984 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:37.741816 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:37.743339 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:37.745749 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:37.747559 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:37.752129 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:37.824471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Getting quotas for project c525ea582b264cd5866aa7f403999cba. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:23:37.839801 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Getting quotas for user c019d1c81a764d42b98222c8146b8ce2 and project c525ea582b264cd5866aa7f403999cba. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:23:37.875523 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Going to run 1 instances... {{(pid=120540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:23:37.881672 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:23:38.072848 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-d9227477-6ac6-4d92-a8bf-830f90ea145d tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.840295 Aug 26 18:23:38.077550 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 6/21] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:23:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 18:23:38.099988 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bc367d11-06bd-47e8-830d-4d606321e955 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:38.100856 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bc367d11-06bd-47e8-830d-4d606321e955 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:38.256120 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-fe35dada-37da-496f-906f-76f0aa36a268 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc7446e25e0>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:38.340410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-fe35dada-37da-496f-906f-76f0aa36a268 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213" status: 200 len: 286 microversion: 2.1 time: 0.088992 Aug 26 18:23:38.341295 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 7/22] 10.222.0.45 () {58 vars in 1251 bytes} [Fri Aug 26 18:23:38 2022] GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:23:38.507782 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bc367d11-06bd-47e8-830d-4d606321e955 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:38.532961 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bc367d11-06bd-47e8-830d-4d606321e955 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1214 microversion: 2.1 time: 0.441251 Aug 26 18:23:38.534100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 16/23] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:38 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1214 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:39.354453 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fb540afa-5eb8-4e63-aa4d-132b6f2c5069 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc745002af0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:39.401421 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-fb540afa-5eb8-4e63-aa4d-132b6f2c5069 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] HTTP exception thrown: Snapshot c315cb21-64f3-469c-a950-189039664213 could not be found. Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fb540afa-5eb8-4e63-aa4d-132b6f2c5069 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Request method failure captured: Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213 HTTP/1.1 Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ-eJbgDY6wkPiNuQNFnXK8ToMZefJXQdW7kTI6XzSvLHlVjjcp9uLPs5M7j_9adLzpHIboblPFiatTfREnKBJjKZQsv-fAhCK_VCuSPM3wQFS1buZzVScsR2LSvdvV9hBHaSztHYJpQvgxBP5yHHFNm9BlzXXVOT-3tUUclIvZSrvQ Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 80a905d4d8b140bf8a30530e403d2209 Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1056517973 Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:23:39.408691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:23:39.409862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_80a905d4d8b140bf8a30530e403d2209", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/80a905d4d8b140bf8a30530e403d2209"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/80a905d4d8b140bf8a30530e403d2209"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/80a905d4d8b140bf8a30530e403d2209"}]}] Aug 26 18:23:39.409862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1056517973 Aug 26 18:23:39.409862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 80a905d4d8b140bf8a30530e403d2209 Aug 26 18:23:39.409862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1056517973 Aug 26 18:23:39.409862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesSnapshotsTestJSON-1056517973-project Aug 26 18:23:39.409862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:23:39.409862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:23:39.409862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: a18d614cf7fc4aa6b12c295bbf1308b4 Aug 26 18:23:39.409862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1056517973-project Aug 26 18:23:39.409862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: Aug 26 18:23:39.409862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Snapshot c315cb21-64f3-469c-a950-189039664213 could not be found. Aug 26 18:23:39.409862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': 'c315cb21-64f3-469c-a950-189039664213'} Aug 26 18:23:39.409862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c315cb21-64f3-469c-a950-189039664213 could not be found. (HTTP 404) (Request-ID: req-a60a95fe-9a67-4c9f-8920-4c1b9252b65a) Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:23:39.410532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 18:23:39.411463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c315cb21-64f3-469c-a950-189039664213 could not be found. Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 26 18:23:39.412358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:23:39.414863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c315cb21-64f3-469c-a950-189039664213 could not be found. Aug 26 18:23:39.414863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:23:39.414863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:23:39.414863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:23:39.414863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:39.414863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:23:39.414863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:23:39.414863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:23:39.414863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:23:39.414863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c315cb21-64f3-469c-a950-189039664213 could not be found. Aug 26 18:23:39.414863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:23:39.414863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fb540afa-5eb8-4e63-aa4d-132b6f2c5069 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Returning 404 to user: Snapshot c315cb21-64f3-469c-a950-189039664213 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:23:39.414863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fb540afa-5eb8-4e63-aa4d-132b6f2c5069 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213" status: 404 len: 111 microversion: 2.1 time: 0.061416 Aug 26 18:23:39.418113 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 17/24] 10.222.0.45 () {58 vars in 1251 bytes} [Fri Aug 26 18:23:39 2022] GET /compute/v2.1/os-snapshots/c315cb21-64f3-469c-a950-189039664213 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 18:23:39.441633 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1d88708f-4499-4e1a-9335-174f16a18f82 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc7459e6310>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:39.649492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1d88708f-4499-4e1a-9335-174f16a18f82 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc" status: 202 len: 0 microversion: 2.1 time: 0.230886 Aug 26 18:23:39.650466 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 18/25] 10.222.0.45 () {58 vars in 1248 bytes} [Fri Aug 26 18:23:39 2022] DELETE /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:23:39.657885 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1e636757-6733-4055-a9da-dbed7a8ee01a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:39.659488 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1e636757-6733-4055-a9da-dbed7a8ee01a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:39.921172 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-943899767", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:23:39.957404 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1e636757-6733-4055-a9da-dbed7a8ee01a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:39.969328 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1e636757-6733-4055-a9da-dbed7a8ee01a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1214 microversion: 2.1 time: 0.312804 Aug 26 18:23:39.970172 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 19/26] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:39 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1214 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:40.003148 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-13a2f5ad-f048-4722-a3ed-fbb19d6a7ec9 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc744fa6ee0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:40.064601 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.network.neutron [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] validate_networks() for [('a326cba7-5031-4ab2-a472-9420e131afd8', None, None, None, None, None)] {{(pid=120540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:23:40.167288 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-13a2f5ad-f048-4722-a3ed-fbb19d6a7ec9 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc" status: 200 len: 345 microversion: 2.1 time: 0.184961 Aug 26 18:23:40.168465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 20/27] 10.222.0.45 () {58 vars in 1245 bytes} [Fri Aug 26 18:23:39 2022] GET /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc => generated 345 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:23:40.991482 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a41e8fa8-ec97-44ea-94c9-dba15659c7e2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:40.993468 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a41e8fa8-ec97-44ea-94c9-dba15659c7e2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:41.008893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a41e8fa8-ec97-44ea-94c9-dba15659c7e2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:41.011419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a41e8fa8-ec97-44ea-94c9-dba15659c7e2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:41.014327 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a41e8fa8-ec97-44ea-94c9-dba15659c7e2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:41.017152 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a41e8fa8-ec97-44ea-94c9-dba15659c7e2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:41.018191 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a41e8fa8-ec97-44ea-94c9-dba15659c7e2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:41.018837 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a41e8fa8-ec97-44ea-94c9-dba15659c7e2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:41.406087 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a41e8fa8-ec97-44ea-94c9-dba15659c7e2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:41.432605 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a41e8fa8-ec97-44ea-94c9-dba15659c7e2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1218 microversion: 2.1 time: 0.445407 Aug 26 18:23:41.441063 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 21/28] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:40 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1218 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:23:41.446038 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0b3643e4-71d9-4da5-9b56-a8cc4e7957a9 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc744f26af0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:41.566143 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0b3643e4-71d9-4da5-9b56-a8cc4e7957a9 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc" status: 200 len: 345 microversion: 2.1 time: 0.123889 Aug 26 18:23:41.566699 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 22/29] 10.222.0.45 () {58 vars in 1245 bytes} [Fri Aug 26 18:23:41 2022] GET /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc => generated 345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:23:41.699221 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Flavor limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:23:41.699845 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Image limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:23:41.700218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Flavor pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:23:41.700638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Image pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:23:41.701095 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:23:41.723424 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:41.723914 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:41.724352 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:41.725108 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:41.725576 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:41.725987 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:41.762873 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Getting quotas for project 1a8356be55fb4b19a95da8b77c6e2f9a. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:23:41.775002 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Getting quotas for user c78657cb0d4144cfaf0a7be1e3388ed0 and project 1a8356be55fb4b19a95da8b77c6e2f9a. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:23:41.798161 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Going to run 1 instances... {{(pid=120540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:23:41.805341 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:23:41.933907 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-23def248-5947-42de-bc83-792984f0920d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.872727 Aug 26 18:23:41.936882 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 8/30] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:23:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 2877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 18:23:41.951385 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ccc73bb4-62a5-41c0-9f64-60381478ada2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:41.952644 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ccc73bb4-62a5-41c0-9f64-60381478ada2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:42.129466 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ccc73bb4-62a5-41c0-9f64-60381478ada2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:42.163241 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ccc73bb4-62a5-41c0-9f64-60381478ada2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1221 microversion: 2.1 time: 0.218266 Aug 26 18:23:42.195216 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 23/31] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:41 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1221 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:42.457547 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-391d304c-9e83-4311-af34-a06aa29aaec2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:42.458160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-391d304c-9e83-4311-af34-a06aa29aaec2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:42.509996 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1441496966", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:23:42.533792 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-391d304c-9e83-4311-af34-a06aa29aaec2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:42.543234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-391d304c-9e83-4311-af34-a06aa29aaec2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:42.547218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-391d304c-9e83-4311-af34-a06aa29aaec2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:42.548475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-391d304c-9e83-4311-af34-a06aa29aaec2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:42.549513 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-391d304c-9e83-4311-af34-a06aa29aaec2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:42.550604 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-391d304c-9e83-4311-af34-a06aa29aaec2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:42.893573 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] validate_networks() for [('a326cba7-5031-4ab2-a472-9420e131afd8', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:23:43.164206 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-391d304c-9e83-4311-af34-a06aa29aaec2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:43.226427 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-391d304c-9e83-4311-af34-a06aa29aaec2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1266 microversion: 2.1 time: 0.772360 Aug 26 18:23:43.243135 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 9/32] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:42 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1266 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:43.259979 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-10d0ea47-e8a2-4aba-a8a6-7d97f3207852 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc7445c3550>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:43.366740 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-10d0ea47-e8a2-4aba-a8a6-7d97f3207852 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] HTTP exception thrown: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-10d0ea47-e8a2-4aba-a8a6-7d97f3207852 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Request method failure captured: Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc HTTP/1.1 Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ-eJbgDY6wkPiNuQNFnXK8ToMZefJXQdW7kTI6XzSvLHlVjjcp9uLPs5M7j_9adLzpHIboblPFiatTfREnKBJjKZQsv-fAhCK_VCuSPM3wQFS1buZzVScsR2LSvdvV9hBHaSztHYJpQvgxBP5yHHFNm9BlzXXVOT-3tUUclIvZSrvQ Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 80a905d4d8b140bf8a30530e403d2209 Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1056517973 Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:23:43.369628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:23:43.370863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_80a905d4d8b140bf8a30530e403d2209", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/80a905d4d8b140bf8a30530e403d2209"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/80a905d4d8b140bf8a30530e403d2209"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/80a905d4d8b140bf8a30530e403d2209"}]}] Aug 26 18:23:43.370863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1056517973 Aug 26 18:23:43.370863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 80a905d4d8b140bf8a30530e403d2209 Aug 26 18:23:43.370863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1056517973 Aug 26 18:23:43.370863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-VolumesSnapshotsTestJSON-1056517973-project Aug 26 18:23:43.370863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:23:43.370863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:23:43.370863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: a18d614cf7fc4aa6b12c295bbf1308b4 Aug 26 18:23:43.370863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1056517973-project Aug 26 18:23:43.370863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: Aug 26 18:23:43.370863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. Aug 26 18:23:43.370863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc'} Aug 26 18:23:43.370863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. (HTTP 404) (Request-ID: req-0a79ec4b-2e00-4d1f-9a4d-47314bef3e89) Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:23:43.371536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 18:23:43.372489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 18:23:43.377124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:23:43.378083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. Aug 26 18:23:43.378083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:43.378083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:23:43.378083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:43.378083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:43.378083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:23:43.378083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:23:43.378083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:23:43.378083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:23:43.378083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. Aug 26 18:23:43.378083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:43.378083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-10d0ea47-e8a2-4aba-a8a6-7d97f3207852 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Returning 404 to user: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:23:43.378083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-10d0ea47-e8a2-4aba-a8a6-7d97f3207852 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc" status: 404 len: 109 microversion: 2.1 time: 0.125623 Aug 26 18:23:43.378083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 10/33] 10.222.0.45 () {58 vars in 1245 bytes} [Fri Aug 26 18:23:43 2022] GET /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:23:43.769086 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-54c84043-f9c7-4138-9664-c1c048996928 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Action: 'create', calling method: .version_select at 0x7fc7445cd160>, body: {"keypair": {"name": "tempest-keypair-1199745493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDAMKRzyPHiG0umaNESUdFJmXEndFZj0sVQQPxJlwuDoP6s/uger8aBee9ZUF/15zlDN6AZfXDhd9CBB+ZHB8wiVEp7lPJHXegLy92xSc7AuMHjFfin7LW3a1BvM6NKNw=="}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:23:43.896983 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-54c84043-f9c7-4138-9664-c1c048996928 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Getting quotas for project 4e1167fc380043c5b04a6746d715003a. Resources: {'key_pairs'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:23:43.915774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-54c84043-f9c7-4138-9664-c1c048996928 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Getting quotas for user cde02839effc4354a4fd7e82c1dc8e26 and project 4e1167fc380043c5b04a6746d715003a. Resources: {'key_pairs'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:23:44.011685 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-54c84043-f9c7-4138-9664-c1c048996928 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.637574 Aug 26 18:23:44.024234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 11/34] 10.222.0.45 () {62 vars in 1200 bytes} [Fri Aug 26 18:23:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 651 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 26 18:23:44.048391 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0775f08a-4e6b-4bce-9630-c349f23e0f25 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc7445d1280>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:44.125911 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-0775f08a-4e6b-4bce-9630-c349f23e0f25 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] HTTP exception thrown: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0775f08a-4e6b-4bce-9630-c349f23e0f25 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Request method failure captured: Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: DELETE /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc HTTP/1.1 Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ-eJbgDY6wkPiNuQNFnXK8ToMZefJXQdW7kTI6XzSvLHlVjjcp9uLPs5M7j_9adLzpHIboblPFiatTfREnKBJjKZQsv-fAhCK_VCuSPM3wQFS1buZzVScsR2LSvdvV9hBHaSztHYJpQvgxBP5yHHFNm9BlzXXVOT-3tUUclIvZSrvQ Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 80a905d4d8b140bf8a30530e403d2209 Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1056517973 Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:23:44.140127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:23:44.141383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_80a905d4d8b140bf8a30530e403d2209", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/80a905d4d8b140bf8a30530e403d2209"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/80a905d4d8b140bf8a30530e403d2209"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/80a905d4d8b140bf8a30530e403d2209"}]}] Aug 26 18:23:44.141383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1056517973 Aug 26 18:23:44.141383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 80a905d4d8b140bf8a30530e403d2209 Aug 26 18:23:44.141383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1056517973 Aug 26 18:23:44.141383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-VolumesSnapshotsTestJSON-1056517973-project Aug 26 18:23:44.141383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:23:44.141383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:23:44.141383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: a18d614cf7fc4aa6b12c295bbf1308b4 Aug 26 18:23:44.141383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1056517973-project Aug 26 18:23:44.141383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: Aug 26 18:23:44.141383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. Aug 26 18:23:44.141383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc'} Aug 26 18:23:44.141383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. (HTTP 404) (Request-ID: req-3b5e96f1-371c-45b5-ae0a-e7a91da0ca6a) Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:23:44.142188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 18:23:44.146336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 18:23:44.150034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:23:44.154756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. Aug 26 18:23:44.154756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:44.154756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:23:44.154756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:44.154756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:44.154756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:23:44.154756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:23:44.154756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:23:44.154756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:23:44.154756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. Aug 26 18:23:44.154756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:44.154756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0775f08a-4e6b-4bce-9630-c349f23e0f25 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Returning 404 to user: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:23:44.154756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-0775f08a-4e6b-4bce-9630-c349f23e0f25 tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc" status: 404 len: 109 microversion: 2.1 time: 0.116143 Aug 26 18:23:44.154756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 12/35] 10.222.0.45 () {58 vars in 1248 bytes} [Fri Aug 26 18:23:44 2022] DELETE /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:23:44.163560 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-b769b03b-5b0a-4d5a-99be-2938a530675f tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Calling method '.version_select at 0x7fc7445f4040>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:44.250407 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-b769b03b-5b0a-4d5a-99be-2938a530675f tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] HTTP exception thrown: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-b769b03b-5b0a-4d5a-99be-2938a530675f tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Request method failure captured: Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc HTTP/1.1 Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ-eJbgDY6wkPiNuQNFnXK8ToMZefJXQdW7kTI6XzSvLHlVjjcp9uLPs5M7j_9adLzpHIboblPFiatTfREnKBJjKZQsv-fAhCK_VCuSPM3wQFS1buZzVScsR2LSvdvV9hBHaSztHYJpQvgxBP5yHHFNm9BlzXXVOT-3tUUclIvZSrvQ Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 80a905d4d8b140bf8a30530e403d2209 Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1056517973 Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:23:44.254049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:23:44.255118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_80a905d4d8b140bf8a30530e403d2209", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/80a905d4d8b140bf8a30530e403d2209"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/80a905d4d8b140bf8a30530e403d2209"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/80a905d4d8b140bf8a30530e403d2209"}]}] Aug 26 18:23:44.255118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1056517973 Aug 26 18:23:44.255118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 80a905d4d8b140bf8a30530e403d2209 Aug 26 18:23:44.255118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1056517973 Aug 26 18:23:44.255118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-VolumesSnapshotsTestJSON-1056517973-project Aug 26 18:23:44.255118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:23:44.255118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:23:44.255118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: a18d614cf7fc4aa6b12c295bbf1308b4 Aug 26 18:23:44.255118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1056517973-project Aug 26 18:23:44.255118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: Aug 26 18:23:44.255118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. Aug 26 18:23:44.255118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc'} Aug 26 18:23:44.255118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. (HTTP 404) (Request-ID: req-c7f344d9-6be1-4a06-b654-ede431184fbb) Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:23:44.255758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 18:23:44.256668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 18:23:44.257715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:23:44.258638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. Aug 26 18:23:44.258638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:44.258638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:23:44.258638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:44.258638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:23:44.258638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:23:44.258638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:23:44.258638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:23:44.258638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:23:44.258638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. Aug 26 18:23:44.258638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:23:44.258638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-b769b03b-5b0a-4d5a-99be-2938a530675f tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] Returning 404 to user: Volume 44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:23:44.258638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-b769b03b-5b0a-4d5a-99be-2938a530675f tempest-VolumesSnapshotsTestJSON-1056517973 tempest-VolumesSnapshotsTestJSON-1056517973-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc" status: 404 len: 109 microversion: 2.1 time: 0.104501 Aug 26 18:23:44.258638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 13/36] 10.222.0.45 () {58 vars in 1245 bytes} [Fri Aug 26 18:23:44 2022] GET /compute/v2.1/os-volumes/44d2e6a9-0e88-4e0a-85c5-b8e4a38224fc => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:23:44.270199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-64a25729-8880-471a-a018-82c1f239a9c0 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:44.271296 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-64a25729-8880-471a-a018-82c1f239a9c0 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:44.298533 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64a25729-8880-471a-a018-82c1f239a9c0 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:44.299278 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64a25729-8880-471a-a018-82c1f239a9c0 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:44.299917 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64a25729-8880-471a-a018-82c1f239a9c0 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:44.304936 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64a25729-8880-471a-a018-82c1f239a9c0 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:44.306896 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64a25729-8880-471a-a018-82c1f239a9c0 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:44.310542 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64a25729-8880-471a-a018-82c1f239a9c0 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:44.492611 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-64a25729-8880-471a-a018-82c1f239a9c0 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:44.502632 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-64a25729-8880-471a-a018-82c1f239a9c0 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1272 microversion: 2.1 time: 0.245463 Aug 26 18:23:44.505257 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 14/37] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:44 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:45.167649 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-83dc5027-b1f0-4656-8b50-455d9bdd64b7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Action: 'create', calling method: .version_select at 0x7fc7445d10d0>, body: {"keypair": {"name": "tempest-keypair-1918747375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoc5YWBZDGcqaky1HoxoMqR/G5gU0r/xtXdmKIbN6i/hCuJr5nLUJm/SUru9awArXwWVZMdBaUW68SlkfChPQzs+7bS0I0eQaTH5N/YGkPs1ZABA3qo7t6lPSDDPH+xsQ=="}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:23:45.234055 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-83dc5027-b1f0-4656-8b50-455d9bdd64b7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Getting quotas for project dd848c03af214b948ab01dee79cb7c34. Resources: {'key_pairs'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:23:45.256511 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-83dc5027-b1f0-4656-8b50-455d9bdd64b7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Getting quotas for user 85158030e4904eab877dc5da3a6bbd33 and project dd848c03af214b948ab01dee79cb7c34. Resources: {'key_pairs'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:23:45.337152 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-83dc5027-b1f0-4656-8b50-455d9bdd64b7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.830344 Aug 26 18:23:45.353810 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 15/38] 10.222.0.45 () {60 vars in 1159 bytes} [Fri Aug 26 18:23:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:23:45.528524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9a1491e6-e1fc-4980-ba37-f24c4c009781 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:45.529178 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9a1491e6-e1fc-4980-ba37-f24c4c009781 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:45.535990 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a1491e6-e1fc-4980-ba37-f24c4c009781 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:45.544650 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a1491e6-e1fc-4980-ba37-f24c4c009781 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:45.548920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a1491e6-e1fc-4980-ba37-f24c4c009781 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:45.554497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a1491e6-e1fc-4980-ba37-f24c4c009781 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:45.560678 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a1491e6-e1fc-4980-ba37-f24c4c009781 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:45.561270 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a1491e6-e1fc-4980-ba37-f24c4c009781 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:45.940644 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9a1491e6-e1fc-4980-ba37-f24c4c009781 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:45.959004 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9a1491e6-e1fc-4980-ba37-f24c4c009781 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1272 microversion: 2.1 time: 0.434883 Aug 26 18:23:45.962823 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 16/39] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:45 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1272 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:46.992537 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e20e5655-dea4-4112-ac1e-dc20b5dd9190 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:46.995168 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e20e5655-dea4-4112-ac1e-dc20b5dd9190 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:47.018137 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e20e5655-dea4-4112-ac1e-dc20b5dd9190 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:47.022031 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e20e5655-dea4-4112-ac1e-dc20b5dd9190 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:47.024400 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e20e5655-dea4-4112-ac1e-dc20b5dd9190 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:47.027345 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e20e5655-dea4-4112-ac1e-dc20b5dd9190 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:47.030450 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e20e5655-dea4-4112-ac1e-dc20b5dd9190 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:47.034214 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e20e5655-dea4-4112-ac1e-dc20b5dd9190 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:47.662120 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e20e5655-dea4-4112-ac1e-dc20b5dd9190 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:47.674853 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e20e5655-dea4-4112-ac1e-dc20b5dd9190 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1272 microversion: 2.1 time: 0.691455 Aug 26 18:23:47.692596 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 17/40] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:46 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1272 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:48.294732 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:23:48.295343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:23:48.295622 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:23:48.296048 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:23:48.296461 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:23:48.340678 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:48.341263 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:48.342186 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:48.345222 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:48.345814 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:48.346667 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:48.579879 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Getting quotas for project 1a8356be55fb4b19a95da8b77c6e2f9a. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:23:48.608592 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Getting quotas for user c78657cb0d4144cfaf0a7be1e3388ed0 and project 1a8356be55fb4b19a95da8b77c6e2f9a. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:23:48.662408 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:23:48.676668 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:23:48.697777 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f7ea280d-5718-4fc7-9a57-8f54ac58b271 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:48.699035 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f7ea280d-5718-4fc7-9a57-8f54ac58b271 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:48.707886 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7ea280d-5718-4fc7-9a57-8f54ac58b271 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:48.708439 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7ea280d-5718-4fc7-9a57-8f54ac58b271 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:48.708846 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7ea280d-5718-4fc7-9a57-8f54ac58b271 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:48.709559 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7ea280d-5718-4fc7-9a57-8f54ac58b271 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:48.710004 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7ea280d-5718-4fc7-9a57-8f54ac58b271 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:48.710425 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7ea280d-5718-4fc7-9a57-8f54ac58b271 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:48.947741 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-16485df8-95dd-4318-9de1-3faddea0c43d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.438906 Aug 26 18:23:48.951289 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 24/41] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:23:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 6448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 18:23:48.979142 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0a7ce6a7-456f-4344-aa79-cadeff9f1768 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:49.003939 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0a7ce6a7-456f-4344-aa79-cadeff9f1768 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:49.251441 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0a7ce6a7-456f-4344-aa79-cadeff9f1768 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:49.262710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0a7ce6a7-456f-4344-aa79-cadeff9f1768 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1222 microversion: 2.1 time: 0.304425 Aug 26 18:23:49.283168 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 25/42] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:48 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1222 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:50.299506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eb81932e-818c-4888-9724-e17c2f7d62da tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:50.300963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eb81932e-818c-4888-9724-e17c2f7d62da tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:50.320476 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f7ea280d-5718-4fc7-9a57-8f54ac58b271 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:50.338728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f7ea280d-5718-4fc7-9a57-8f54ac58b271 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 1.645001 Aug 26 18:23:50.364001 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 18/43] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:48 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:51.096969 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eb81932e-818c-4888-9724-e17c2f7d62da tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:51.110644 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eb81932e-818c-4888-9724-e17c2f7d62da tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1222 microversion: 2.1 time: 0.815609 Aug 26 18:23:51.112601 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 26/44] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:50 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1222 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:51.371225 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-6726a6ae-3334-460b-ab5e-214206577c09 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:51.372445 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-6726a6ae-3334-460b-ab5e-214206577c09 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:51.381752 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6726a6ae-3334-460b-ab5e-214206577c09 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:51.386150 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6726a6ae-3334-460b-ab5e-214206577c09 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:51.390272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6726a6ae-3334-460b-ab5e-214206577c09 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:51.392106 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6726a6ae-3334-460b-ab5e-214206577c09 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:51.396444 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6726a6ae-3334-460b-ab5e-214206577c09 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:51.397175 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6726a6ae-3334-460b-ab5e-214206577c09 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:51.738622 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=4 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:52.134630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-582a9c79-46ae-4e9a-b1b5-8e4c26b124a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:52.135965 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-582a9c79-46ae-4e9a-b1b5-8e4c26b124a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:52.151069 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-582a9c79-46ae-4e9a-b1b5-8e4c26b124a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:52.153463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-582a9c79-46ae-4e9a-b1b5-8e4c26b124a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:52.163780 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-582a9c79-46ae-4e9a-b1b5-8e4c26b124a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:52.170195 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-582a9c79-46ae-4e9a-b1b5-8e4c26b124a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:52.174863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-582a9c79-46ae-4e9a-b1b5-8e4c26b124a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:52.175475 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-582a9c79-46ae-4e9a-b1b5-8e4c26b124a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:52.486525 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-582a9c79-46ae-4e9a-b1b5-8e4c26b124a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:52.498070 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-582a9c79-46ae-4e9a-b1b5-8e4c26b124a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1280 microversion: 2.1 time: 0.366228 Aug 26 18:23:52.498648 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 27/45] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:52 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1280 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:23:52.957918 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6726a6ae-3334-460b-ab5e-214206577c09 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:52.972017 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-6726a6ae-3334-460b-ab5e-214206577c09 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 1.605166 Aug 26 18:23:52.986159 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 19/46] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:51 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:53.523965 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ef3ade6e-637d-4b62-ba5f-d72fe1958d71 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:53.527090 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ef3ade6e-637d-4b62-ba5f-d72fe1958d71 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:53.549670 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef3ade6e-637d-4b62-ba5f-d72fe1958d71 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:53.551004 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef3ade6e-637d-4b62-ba5f-d72fe1958d71 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:53.556100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef3ade6e-637d-4b62-ba5f-d72fe1958d71 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:53.561299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef3ade6e-637d-4b62-ba5f-d72fe1958d71 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:53.562936 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef3ade6e-637d-4b62-ba5f-d72fe1958d71 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:53.563941 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef3ade6e-637d-4b62-ba5f-d72fe1958d71 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:53.849730 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1524313487", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f8ca64c-3b3d-4193-a2ad-338b8fd1327b"}], "security_groups": [{"name": "tempest-securitygroup--1298387700"}], "key_name": "tempest-keypair-1199745493", "user_data": "}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:23:54.022181 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ef3ade6e-637d-4b62-ba5f-d72fe1958d71 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:54.031267 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ef3ade6e-637d-4b62-ba5f-d72fe1958d71 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1280 microversion: 2.1 time: 0.510590 Aug 26 18:23:54.049115 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 28/47] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:53 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1280 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:54.058799 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fa2f9157-6990-4c4b-ae68-b86eeb380dcf tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:54.068460 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fa2f9157-6990-4c4b-ae68-b86eeb380dcf tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:54.101904 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa2f9157-6990-4c4b-ae68-b86eeb380dcf tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:54.104344 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa2f9157-6990-4c4b-ae68-b86eeb380dcf tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:54.107408 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa2f9157-6990-4c4b-ae68-b86eeb380dcf tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:54.113145 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa2f9157-6990-4c4b-ae68-b86eeb380dcf tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:54.113673 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa2f9157-6990-4c4b-ae68-b86eeb380dcf tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:54.120320 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa2f9157-6990-4c4b-ae68-b86eeb380dcf tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:54.793835 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.network.neutron [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] validate_networks() for [('5f8ca64c-3b3d-4193-a2ad-338b8fd1327b', None, None, None, None, None)] {{(pid=120540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:23:55.015393 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fa2f9157-6990-4c4b-ae68-b86eeb380dcf tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:55.022586 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fa2f9157-6990-4c4b-ae68-b86eeb380dcf tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.973302 Aug 26 18:23:55.031002 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 29/48] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:54 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:55.064596 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-23b83e74-b900-4e18-828f-a1801b859d58 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:55.066049 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-23b83e74-b900-4e18-828f-a1801b859d58 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:55.076022 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23b83e74-b900-4e18-828f-a1801b859d58 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:55.082429 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23b83e74-b900-4e18-828f-a1801b859d58 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:55.083119 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23b83e74-b900-4e18-828f-a1801b859d58 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:55.084114 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23b83e74-b900-4e18-828f-a1801b859d58 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:55.084881 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23b83e74-b900-4e18-828f-a1801b859d58 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:55.085499 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23b83e74-b900-4e18-828f-a1801b859d58 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:55.280853 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-23b83e74-b900-4e18-828f-a1801b859d58 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:55.286821 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=20 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:55.290316 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-23b83e74-b900-4e18-828f-a1801b859d58 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1280 microversion: 2.1 time: 0.230307 Aug 26 18:23:55.295705 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 30/49] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:55 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1280 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:56.153521 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-7cf476d5-ff0b-45c4-85ae-5917cd1689b4 req-c9417b9e-b635-4c97-a1a8-73281b02a488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c88ac3fc-3407-4752-8978-4284558e0cfe", "tag": "62f67bf0-ea26-4bf6-a2f2-413adc6e16e0"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:23:56.198535 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-7cf476d5-ff0b-45c4-85ae-5917cd1689b4 req-c9417b9e-b635-4c97-a1a8-73281b02a488 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:56.208038 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-7cf476d5-ff0b-45c4-85ae-5917cd1689b4 req-c9417b9e-b635-4c97-a1a8-73281b02a488 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:56.209798 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-7cf476d5-ff0b-45c4-85ae-5917cd1689b4 req-c9417b9e-b635-4c97-a1a8-73281b02a488 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:56.267378 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-7cf476d5-ff0b-45c4-85ae-5917cd1689b4 req-c9417b9e-b635-4c97-a1a8-73281b02a488 service nova] Creating event network-changed:62f67bf0-ea26-4bf6-a2f2-413adc6e16e0 for instance c88ac3fc-3407-4752-8978-4284558e0cfe on hv-cinder-85199 Aug 26 18:23:56.269481 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-7cf476d5-ff0b-45c4-85ae-5917cd1689b4 req-c9417b9e-b635-4c97-a1a8-73281b02a488 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 18:23:56.270420 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-7cf476d5-ff0b-45c4-85ae-5917cd1689b4 req-c9417b9e-b635-4c97-a1a8-73281b02a488 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 18:23:56.272000 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f420493b-211a-474d-ba1a-90ba90c12b97 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:56.274704 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f420493b-211a-474d-ba1a-90ba90c12b97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:56.275489 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f420493b-211a-474d-ba1a-90ba90c12b97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:56.276884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f420493b-211a-474d-ba1a-90ba90c12b97 None None] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:56.277604 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f420493b-211a-474d-ba1a-90ba90c12b97 None None] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:56.278341 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f420493b-211a-474d-ba1a-90ba90c12b97 None None] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:56.290959 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.compute.rpcapi [None req-f420493b-211a-474d-ba1a-90ba90c12b97 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 18:23:56.292524 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f420493b-211a-474d-ba1a-90ba90c12b97 None None] Releasing lock "compute-rpcapi-router" {{(pid=120539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 18:23:56.312036 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f420493b-211a-474d-ba1a-90ba90c12b97 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.339427 Aug 26 18:23:56.315034 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 31/50] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:23:56.332578 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fcbd6ab2-270d-485a-a8c3-88d5e79609d9 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:56.337249 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fcbd6ab2-270d-485a-a8c3-88d5e79609d9 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:56.355450 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcbd6ab2-270d-485a-a8c3-88d5e79609d9 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:56.356310 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcbd6ab2-270d-485a-a8c3-88d5e79609d9 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:56.357319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcbd6ab2-270d-485a-a8c3-88d5e79609d9 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:56.361528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcbd6ab2-270d-485a-a8c3-88d5e79609d9 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:56.362399 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcbd6ab2-270d-485a-a8c3-88d5e79609d9 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:56.363247 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcbd6ab2-270d-485a-a8c3-88d5e79609d9 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:57.468368 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Flavor limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:23:57.469564 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Image limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:23:57.470298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Flavor pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:23:57.471082 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Image pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:23:57.471673 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:23:57.479965 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=8 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:23:57.534439 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:57.535247 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:57.535901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:57.538038 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:57.538789 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:57.540489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:57.598334 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Getting quotas for project 4e1167fc380043c5b04a6746d715003a. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:23:57.616154 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Getting quotas for user cde02839effc4354a4fd7e82c1dc8e26 and project 4e1167fc380043c5b04a6746d715003a. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:23:57.632312 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Going to run 1 instances... {{(pid=120540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:23:57.634859 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:23:57.758827 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-5dc189a9-fa90-4164-9df8-6a83420e0ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.915501 Aug 26 18:23:57.761416 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 20/51] 10.222.0.45 () {62 vars in 1188 bytes} [Fri Aug 26 18:23:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 3919 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 26 18:23:57.776673 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1f93a928-3d12-4848-80a9-05cbff6be036 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:57.777717 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1f93a928-3d12-4848-80a9-05cbff6be036 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:57.789850 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1f93a928-3d12-4848-80a9-05cbff6be036 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:57.790580 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1f93a928-3d12-4848-80a9-05cbff6be036 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:57.791166 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1f93a928-3d12-4848-80a9-05cbff6be036 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:57.792097 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1f93a928-3d12-4848-80a9-05cbff6be036 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:57.792685 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1f93a928-3d12-4848-80a9-05cbff6be036 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:57.793364 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1f93a928-3d12-4848-80a9-05cbff6be036 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:58.092317 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fcbd6ab2-270d-485a-a8c3-88d5e79609d9 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:58.107949 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fcbd6ab2-270d-485a-a8c3-88d5e79609d9 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 1.786591 Aug 26 18:23:58.110335 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 32/52] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:56 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:58.127417 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1833139699", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4dcd9f1b-d41d-4f89-929b-818235bdfa4c"}], "security_groups": [{"name": "tempest-securitygroup--383292384"}], "key_name": "tempest-keypair-1918747375", "user_data": "}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:23:58.475773 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] validate_networks() for [('4dcd9f1b-d41d-4f89-929b-818235bdfa4c', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:23:58.705670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1f93a928-3d12-4848-80a9-05cbff6be036 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:58.724792 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1f93a928-3d12-4848-80a9-05cbff6be036 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.960709 Aug 26 18:23:58.725464 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 21/53] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:57 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:58.770370 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-90225a27-237a-4390-8dc8-31c0b6e9f371 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:58.771087 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-90225a27-237a-4390-8dc8-31c0b6e9f371 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:59.303346 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-90225a27-237a-4390-8dc8-31c0b6e9f371 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:59.337947 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-90225a27-237a-4390-8dc8-31c0b6e9f371 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:59.343876 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-90225a27-237a-4390-8dc8-31c0b6e9f371 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:59.347438 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-90225a27-237a-4390-8dc8-31c0b6e9f371 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1282 microversion: 2.20 time: 0.597727 Aug 26 18:23:59.350480 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 22/54] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:23:58 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1282 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:23:59.359551 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-981c6ea8-15fd-4a7a-a221-805554de0368 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:23:59.362097 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-981c6ea8-15fd-4a7a-a221-805554de0368 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:23:59.378296 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-981c6ea8-15fd-4a7a-a221-805554de0368 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:59.379565 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-981c6ea8-15fd-4a7a-a221-805554de0368 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:59.381888 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-981c6ea8-15fd-4a7a-a221-805554de0368 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:59.382910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-981c6ea8-15fd-4a7a-a221-805554de0368 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:59.388322 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-981c6ea8-15fd-4a7a-a221-805554de0368 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:59.388985 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-981c6ea8-15fd-4a7a-a221-805554de0368 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:59.799709 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-981c6ea8-15fd-4a7a-a221-805554de0368 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:23:59.814479 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-981c6ea8-15fd-4a7a-a221-805554de0368 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.462404 Aug 26 18:23:59.818345 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 23/55] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:23:59 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:23:59.958686 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:23:59.959272 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:23:59.959525 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:23:59.959995 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:23:59.960564 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:23:59.978110 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:59.978941 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:59.979700 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:23:59.980657 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:23:59.981309 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:23:59.982052 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:00.023758 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Getting quotas for project dd848c03af214b948ab01dee79cb7c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:24:00.040046 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Getting quotas for user 85158030e4904eab877dc5da3a6bbd33 and project dd848c03af214b948ab01dee79cb7c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:24:00.057077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:24:00.059802 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:24:00.138192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-af83940f-eb2c-4b4a-b940-048b1394811a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.024270 Aug 26 18:24:00.149933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 33/56] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:23:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 2037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 18:24:00.155556 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-350a968c-2efd-4811-a1b8-c3fab244f814 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:00.157290 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-350a968c-2efd-4811-a1b8-c3fab244f814 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:00.186636 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-350a968c-2efd-4811-a1b8-c3fab244f814 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:00.194050 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-350a968c-2efd-4811-a1b8-c3fab244f814 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:00.194540 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-350a968c-2efd-4811-a1b8-c3fab244f814 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:00.195286 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-350a968c-2efd-4811-a1b8-c3fab244f814 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:00.195742 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-350a968c-2efd-4811-a1b8-c3fab244f814 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:00.196169 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-350a968c-2efd-4811-a1b8-c3fab244f814 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:00.214542 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-e79ea327-5a87-4e00-a96f-87de554b72e9 req-6e66b350-d791-4112-99c5-2359d1af59aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6249cc1c-c171-41b8-81d5-2d73ed7735be", "tag": "bac5114e-f74f-4b09-9068-4de5433c0fdf"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:00.244380 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-e79ea327-5a87-4e00-a96f-87de554b72e9 req-6e66b350-d791-4112-99c5-2359d1af59aa service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:00.245194 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-e79ea327-5a87-4e00-a96f-87de554b72e9 req-6e66b350-d791-4112-99c5-2359d1af59aa service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:00.246912 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-e79ea327-5a87-4e00-a96f-87de554b72e9 req-6e66b350-d791-4112-99c5-2359d1af59aa service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:00.321379 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-e79ea327-5a87-4e00-a96f-87de554b72e9 req-6e66b350-d791-4112-99c5-2359d1af59aa service nova] Creating event network-changed:bac5114e-f74f-4b09-9068-4de5433c0fdf for instance 6249cc1c-c171-41b8-81d5-2d73ed7735be on hv-cinder-85199 Aug 26 18:24:00.324592 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-e79ea327-5a87-4e00-a96f-87de554b72e9 req-6e66b350-d791-4112-99c5-2359d1af59aa service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 18:24:00.334107 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-e79ea327-5a87-4e00-a96f-87de554b72e9 req-6e66b350-d791-4112-99c5-2359d1af59aa service nova] Acquired lock "compute-rpcapi-router" {{(pid=120540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 18:24:00.337359 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ebec68b1-0143-428c-962d-8ab98268286f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:00.339502 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ebec68b1-0143-428c-962d-8ab98268286f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:00.341516 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ebec68b1-0143-428c-962d-8ab98268286f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:00.343572 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ebec68b1-0143-428c-962d-8ab98268286f None None] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:00.344092 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ebec68b1-0143-428c-962d-8ab98268286f None None] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:00.345627 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ebec68b1-0143-428c-962d-8ab98268286f None None] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:00.379701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.compute.rpcapi [None req-ebec68b1-0143-428c-962d-8ab98268286f None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 18:24:00.395393 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ebec68b1-0143-428c-962d-8ab98268286f None None] Releasing lock "compute-rpcapi-router" {{(pid=120540) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 18:24:00.422611 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ebec68b1-0143-428c-962d-8ab98268286f None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.602242 Aug 26 18:24:00.423578 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 24/57] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:24:00.430340 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-134e1b4e-cfb1-45a0-b05d-b29e549d69ab tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:00.432136 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-134e1b4e-cfb1-45a0-b05d-b29e549d69ab tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:00.542177 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-134e1b4e-cfb1-45a0-b05d-b29e549d69ab tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:00.551679 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-134e1b4e-cfb1-45a0-b05d-b29e549d69ab tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1238 microversion: 2.1 time: 0.126174 Aug 26 18:24:00.553078 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 25/58] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:00 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1238 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:00.572845 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-be5953cd-1a01-428b-9f2a-16329fa8037f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:00.575836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-be5953cd-1a01-428b-9f2a-16329fa8037f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:00.588303 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-be5953cd-1a01-428b-9f2a-16329fa8037f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:00.588829 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-be5953cd-1a01-428b-9f2a-16329fa8037f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:00.591528 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-be5953cd-1a01-428b-9f2a-16329fa8037f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:00.592339 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-be5953cd-1a01-428b-9f2a-16329fa8037f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:00.592830 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-be5953cd-1a01-428b-9f2a-16329fa8037f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:00.595387 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-be5953cd-1a01-428b-9f2a-16329fa8037f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:00.646283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-350a968c-2efd-4811-a1b8-c3fab244f814 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:00.673539 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-350a968c-2efd-4811-a1b8-c3fab244f814 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.521734 Aug 26 18:24:00.678893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 34/59] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:00 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:00.718514 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-be5953cd-1a01-428b-9f2a-16329fa8037f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:00.735258 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-be5953cd-1a01-428b-9f2a-16329fa8037f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:00.742293 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-be5953cd-1a01-428b-9f2a-16329fa8037f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:00.744279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-be5953cd-1a01-428b-9f2a-16329fa8037f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1334 microversion: 2.20 time: 0.185323 Aug 26 18:24:00.746770 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 26/60] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:00 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1334 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:00.837564 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cf17cbe3-fef7-4833-935b-d137a60ffbb7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:00.838580 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cf17cbe3-fef7-4833-935b-d137a60ffbb7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:00.846136 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf17cbe3-fef7-4833-935b-d137a60ffbb7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:00.859396 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf17cbe3-fef7-4833-935b-d137a60ffbb7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:00.860759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf17cbe3-fef7-4833-935b-d137a60ffbb7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:00.861813 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf17cbe3-fef7-4833-935b-d137a60ffbb7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:00.863031 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf17cbe3-fef7-4833-935b-d137a60ffbb7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:00.865095 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf17cbe3-fef7-4833-935b-d137a60ffbb7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:01.172465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cf17cbe3-fef7-4833-935b-d137a60ffbb7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:01.181300 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cf17cbe3-fef7-4833-935b-d137a60ffbb7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.347779 Aug 26 18:24:01.181953 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 35/61] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:00 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:01.575608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-a8452363-563f-46bb-9923-ab1fe84a39ef tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:01.576702 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-a8452363-563f-46bb-9923-ab1fe84a39ef tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:01.584317 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a8452363-563f-46bb-9923-ab1fe84a39ef tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:01.584832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a8452363-563f-46bb-9923-ab1fe84a39ef tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:01.585274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a8452363-563f-46bb-9923-ab1fe84a39ef tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:01.589065 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a8452363-563f-46bb-9923-ab1fe84a39ef tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:01.589065 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a8452363-563f-46bb-9923-ab1fe84a39ef tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:01.589065 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a8452363-563f-46bb-9923-ab1fe84a39ef tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:01.652772 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a8452363-563f-46bb-9923-ab1fe84a39ef tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:01.662498 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-a8452363-563f-46bb-9923-ab1fe84a39ef tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1242 microversion: 2.1 time: 0.091855 Aug 26 18:24:01.663261 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 27/62] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:01 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:01.698881 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2e01037c-ecdb-4d12-a138-e2f1a8260820 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:01.699718 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2e01037c-ecdb-4d12-a138-e2f1a8260820 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:01.705913 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e01037c-ecdb-4d12-a138-e2f1a8260820 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:01.706404 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e01037c-ecdb-4d12-a138-e2f1a8260820 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:01.706832 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e01037c-ecdb-4d12-a138-e2f1a8260820 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:01.707538 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e01037c-ecdb-4d12-a138-e2f1a8260820 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:01.708132 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e01037c-ecdb-4d12-a138-e2f1a8260820 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:01.708751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e01037c-ecdb-4d12-a138-e2f1a8260820 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:01.773554 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-6f4e5443-ec3d-49c1-8641-4ebc19857529 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:01.775588 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-6f4e5443-ec3d-49c1-8641-4ebc19857529 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:01.785582 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f4e5443-ec3d-49c1-8641-4ebc19857529 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:01.786206 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f4e5443-ec3d-49c1-8641-4ebc19857529 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:01.786645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f4e5443-ec3d-49c1-8641-4ebc19857529 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:01.788223 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f4e5443-ec3d-49c1-8641-4ebc19857529 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:01.788690 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f4e5443-ec3d-49c1-8641-4ebc19857529 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:01.789145 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f4e5443-ec3d-49c1-8641-4ebc19857529 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:01.879586 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2e01037c-ecdb-4d12-a138-e2f1a8260820 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:01.887798 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6f4e5443-ec3d-49c1-8641-4ebc19857529 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:01.891977 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2e01037c-ecdb-4d12-a138-e2f1a8260820 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.197072 Aug 26 18:24:01.892693 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 36/63] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:01 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:01.897435 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6f4e5443-ec3d-49c1-8641-4ebc19857529 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:01.898713 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6f4e5443-ec3d-49c1-8641-4ebc19857529 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:01.899885 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-6f4e5443-ec3d-49c1-8641-4ebc19857529 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1334 microversion: 2.20 time: 0.132127 Aug 26 18:24:01.900436 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 28/64] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:01 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1334 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:02.204174 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-415734bd-f146-49ec-a595-9b4dbba9f915 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:02.205655 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-415734bd-f146-49ec-a595-9b4dbba9f915 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:02.212216 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-415734bd-f146-49ec-a595-9b4dbba9f915 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:02.212706 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-415734bd-f146-49ec-a595-9b4dbba9f915 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:02.213148 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-415734bd-f146-49ec-a595-9b4dbba9f915 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:02.213837 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-415734bd-f146-49ec-a595-9b4dbba9f915 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:02.214340 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-415734bd-f146-49ec-a595-9b4dbba9f915 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:02.214761 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-415734bd-f146-49ec-a595-9b4dbba9f915 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:02.376354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-415734bd-f146-49ec-a595-9b4dbba9f915 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:02.394323 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-415734bd-f146-49ec-a595-9b4dbba9f915 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.195292 Aug 26 18:24:02.404740 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 37/65] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:02 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:02.444226 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-44baa737-e003-4db0-8771-683b021b33a7 req-eba12f2a-07d3-4aa6-8319-99ad9980f319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6262b31b-ccd3-40d7-8258-7414e80e5893", "tag": "ac74a58e-fb20-452c-9734-c6b8f5f60492"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:02.453923 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-44baa737-e003-4db0-8771-683b021b33a7 req-eba12f2a-07d3-4aa6-8319-99ad9980f319 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:02.454618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-44baa737-e003-4db0-8771-683b021b33a7 req-eba12f2a-07d3-4aa6-8319-99ad9980f319 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:02.455169 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-44baa737-e003-4db0-8771-683b021b33a7 req-eba12f2a-07d3-4aa6-8319-99ad9980f319 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:02.472918 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-44baa737-e003-4db0-8771-683b021b33a7 req-eba12f2a-07d3-4aa6-8319-99ad9980f319 service nova] Creating event network-changed:ac74a58e-fb20-452c-9734-c6b8f5f60492 for instance 6262b31b-ccd3-40d7-8258-7414e80e5893 on hv-cinder-85199 Aug 26 18:24:02.477979 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-44baa737-e003-4db0-8771-683b021b33a7 req-eba12f2a-07d3-4aa6-8319-99ad9980f319 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037502 Aug 26 18:24:02.478847 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 29/66] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:24:02.687662 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-00c45ffe-d605-463a-a722-96b203451a51 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:02.688373 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-00c45ffe-d605-463a-a722-96b203451a51 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:02.694876 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00c45ffe-d605-463a-a722-96b203451a51 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:02.695436 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00c45ffe-d605-463a-a722-96b203451a51 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:02.696031 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00c45ffe-d605-463a-a722-96b203451a51 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:02.696751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00c45ffe-d605-463a-a722-96b203451a51 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:02.697409 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00c45ffe-d605-463a-a722-96b203451a51 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:02.697926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00c45ffe-d605-463a-a722-96b203451a51 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:02.767720 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-00c45ffe-d605-463a-a722-96b203451a51 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:02.776812 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-00c45ffe-d605-463a-a722-96b203451a51 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1242 microversion: 2.1 time: 0.094564 Aug 26 18:24:02.777827 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 38/67] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:02 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:02.917117 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ed4db84f-d8eb-4f68-a0fc-2710c430c788 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:02.919757 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ed4db84f-d8eb-4f68-a0fc-2710c430c788 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:02.923943 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c4519f9f-ed87-41d6-87ec-3e58f8c24eca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:02.924900 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c4519f9f-ed87-41d6-87ec-3e58f8c24eca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:02.940431 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4519f9f-ed87-41d6-87ec-3e58f8c24eca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:02.941043 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ed4db84f-d8eb-4f68-a0fc-2710c430c788 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:02.941777 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ed4db84f-d8eb-4f68-a0fc-2710c430c788 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:02.941895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4519f9f-ed87-41d6-87ec-3e58f8c24eca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:02.942482 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4519f9f-ed87-41d6-87ec-3e58f8c24eca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:02.943345 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4519f9f-ed87-41d6-87ec-3e58f8c24eca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:02.943876 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4519f9f-ed87-41d6-87ec-3e58f8c24eca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:02.944150 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ed4db84f-d8eb-4f68-a0fc-2710c430c788 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:02.944414 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4519f9f-ed87-41d6-87ec-3e58f8c24eca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:02.946101 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ed4db84f-d8eb-4f68-a0fc-2710c430c788 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:02.949793 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ed4db84f-d8eb-4f68-a0fc-2710c430c788 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:02.950524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ed4db84f-d8eb-4f68-a0fc-2710c430c788 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:03.055099 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c4519f9f-ed87-41d6-87ec-3e58f8c24eca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:03.063548 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c4519f9f-ed87-41d6-87ec-3e58f8c24eca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:03.065309 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c4519f9f-ed87-41d6-87ec-3e58f8c24eca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:03.066571 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c4519f9f-ed87-41d6-87ec-3e58f8c24eca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1334 microversion: 2.20 time: 0.149219 Aug 26 18:24:03.067722 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 39/68] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:02 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1334 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:24:03.122525 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ed4db84f-d8eb-4f68-a0fc-2710c430c788 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:03.130478 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ed4db84f-d8eb-4f68-a0fc-2710c430c788 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.220456 Aug 26 18:24:03.131043 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 30/69] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:02 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:03.416013 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-90aa3921-5580-40e4-b3f9-fb546a150aa7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:03.416627 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-90aa3921-5580-40e4-b3f9-fb546a150aa7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:03.423121 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90aa3921-5580-40e4-b3f9-fb546a150aa7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:03.423667 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90aa3921-5580-40e4-b3f9-fb546a150aa7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:03.424027 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90aa3921-5580-40e4-b3f9-fb546a150aa7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:03.424737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90aa3921-5580-40e4-b3f9-fb546a150aa7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:03.425186 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90aa3921-5580-40e4-b3f9-fb546a150aa7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:03.425594 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90aa3921-5580-40e4-b3f9-fb546a150aa7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:03.575885 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-90aa3921-5580-40e4-b3f9-fb546a150aa7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:03.587277 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-90aa3921-5580-40e4-b3f9-fb546a150aa7 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.175056 Aug 26 18:24:03.587887 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 40/70] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:03 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:03.798509 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-61494cf2-15f4-421d-b975-6fd595971de2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:03.799319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-61494cf2-15f4-421d-b975-6fd595971de2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:03.805903 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-61494cf2-15f4-421d-b975-6fd595971de2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:03.806386 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-61494cf2-15f4-421d-b975-6fd595971de2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:03.806821 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-61494cf2-15f4-421d-b975-6fd595971de2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:03.811276 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-61494cf2-15f4-421d-b975-6fd595971de2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:03.811744 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-61494cf2-15f4-421d-b975-6fd595971de2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:03.812318 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-61494cf2-15f4-421d-b975-6fd595971de2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:03.884640 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-61494cf2-15f4-421d-b975-6fd595971de2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:03.893075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-61494cf2-15f4-421d-b975-6fd595971de2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1234 microversion: 2.1 time: 0.098365 Aug 26 18:24:03.893916 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 31/71] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:03 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1234 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:04.089901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b1f58ba4-30e5-4941-8627-82a5ae9e5981 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:04.090528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b1f58ba4-30e5-4941-8627-82a5ae9e5981 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:04.097013 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1f58ba4-30e5-4941-8627-82a5ae9e5981 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:04.097498 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1f58ba4-30e5-4941-8627-82a5ae9e5981 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:04.097937 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1f58ba4-30e5-4941-8627-82a5ae9e5981 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:04.098615 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1f58ba4-30e5-4941-8627-82a5ae9e5981 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:04.099063 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1f58ba4-30e5-4941-8627-82a5ae9e5981 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:04.099481 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1f58ba4-30e5-4941-8627-82a5ae9e5981 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:04.151160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f1822288-2ebb-49ae-840c-5f3f8b77b116 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:04.151881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f1822288-2ebb-49ae-840c-5f3f8b77b116 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:04.159333 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f1822288-2ebb-49ae-840c-5f3f8b77b116 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:04.160050 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f1822288-2ebb-49ae-840c-5f3f8b77b116 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:04.160678 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f1822288-2ebb-49ae-840c-5f3f8b77b116 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:04.161604 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f1822288-2ebb-49ae-840c-5f3f8b77b116 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:04.163008 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f1822288-2ebb-49ae-840c-5f3f8b77b116 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:04.163551 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f1822288-2ebb-49ae-840c-5f3f8b77b116 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:04.164688 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b1f58ba4-30e5-4941-8627-82a5ae9e5981 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:04.174171 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b1f58ba4-30e5-4941-8627-82a5ae9e5981 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:04.176187 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b1f58ba4-30e5-4941-8627-82a5ae9e5981 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:04.177719 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b1f58ba4-30e5-4941-8627-82a5ae9e5981 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1334 microversion: 2.20 time: 0.092265 Aug 26 18:24:04.179691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 41/72] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:04 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:04.343376 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f1822288-2ebb-49ae-840c-5f3f8b77b116 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:04.352358 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f1822288-2ebb-49ae-840c-5f3f8b77b116 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.205223 Aug 26 18:24:04.353006 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 32/73] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:04 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:04.607605 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5d332fde-cd19-445c-8316-77ed59b3285e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:04.608216 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5d332fde-cd19-445c-8316-77ed59b3285e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:04.614302 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d332fde-cd19-445c-8316-77ed59b3285e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:04.614765 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d332fde-cd19-445c-8316-77ed59b3285e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:04.615194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d332fde-cd19-445c-8316-77ed59b3285e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:04.615882 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d332fde-cd19-445c-8316-77ed59b3285e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:04.616335 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d332fde-cd19-445c-8316-77ed59b3285e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:04.616954 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d332fde-cd19-445c-8316-77ed59b3285e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:04.744883 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5d332fde-cd19-445c-8316-77ed59b3285e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:04.752970 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5d332fde-cd19-445c-8316-77ed59b3285e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.149339 Aug 26 18:24:04.753544 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 42/74] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:04 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:04.916670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-de0fd526-9903-4dae-8713-697c8991194e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:04.916670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-de0fd526-9903-4dae-8713-697c8991194e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:04.922222 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de0fd526-9903-4dae-8713-697c8991194e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:04.922758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de0fd526-9903-4dae-8713-697c8991194e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:04.923439 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de0fd526-9903-4dae-8713-697c8991194e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:04.924543 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de0fd526-9903-4dae-8713-697c8991194e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:04.925139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de0fd526-9903-4dae-8713-697c8991194e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:04.925543 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de0fd526-9903-4dae-8713-697c8991194e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:04.945851 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=100 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:04.990546 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-de0fd526-9903-4dae-8713-697c8991194e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:04.998244 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-de0fd526-9903-4dae-8713-697c8991194e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1234 microversion: 2.1 time: 0.086684 Aug 26 18:24:04.998806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 33/75] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:04 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1234 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:05.200998 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2b8603b5-8c38-4b7a-a4f0-a686e12e0c48 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:05.201670 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2b8603b5-8c38-4b7a-a4f0-a686e12e0c48 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:05.203657 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:05.209163 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b8603b5-8c38-4b7a-a4f0-a686e12e0c48 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:05.209815 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b8603b5-8c38-4b7a-a4f0-a686e12e0c48 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:05.210246 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b8603b5-8c38-4b7a-a4f0-a686e12e0c48 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:05.210937 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b8603b5-8c38-4b7a-a4f0-a686e12e0c48 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:05.211381 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b8603b5-8c38-4b7a-a4f0-a686e12e0c48 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:05.211800 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b8603b5-8c38-4b7a-a4f0-a686e12e0c48 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:05.215475 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=99 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:05.279232 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2b8603b5-8c38-4b7a-a4f0-a686e12e0c48 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:05.288007 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2b8603b5-8c38-4b7a-a4f0-a686e12e0c48 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:05.289462 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2b8603b5-8c38-4b7a-a4f0-a686e12e0c48 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:05.290586 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2b8603b5-8c38-4b7a-a4f0-a686e12e0c48 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1334 microversion: 2.20 time: 0.093538 Aug 26 18:24:05.291355 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 43/76] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:05 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:05.375381 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-987ac74d-f6e5-41b9-8891-f3ef1493c25b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:05.375962 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-987ac74d-f6e5-41b9-8891-f3ef1493c25b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:05.381839 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-987ac74d-f6e5-41b9-8891-f3ef1493c25b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:05.382338 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-987ac74d-f6e5-41b9-8891-f3ef1493c25b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:05.382766 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-987ac74d-f6e5-41b9-8891-f3ef1493c25b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:05.383532 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-987ac74d-f6e5-41b9-8891-f3ef1493c25b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:05.383882 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-987ac74d-f6e5-41b9-8891-f3ef1493c25b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:05.384298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-987ac74d-f6e5-41b9-8891-f3ef1493c25b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:05.517401 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-987ac74d-f6e5-41b9-8891-f3ef1493c25b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:05.525459 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-987ac74d-f6e5-41b9-8891-f3ef1493c25b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.153871 Aug 26 18:24:05.526029 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 34/77] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:05 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:05.774575 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d93fde78-643a-45ca-b6e2-75393a845335 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:05.775179 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d93fde78-643a-45ca-b6e2-75393a845335 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:05.781596 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d93fde78-643a-45ca-b6e2-75393a845335 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:05.782021 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d93fde78-643a-45ca-b6e2-75393a845335 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:05.782559 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d93fde78-643a-45ca-b6e2-75393a845335 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:05.783268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d93fde78-643a-45ca-b6e2-75393a845335 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:05.783686 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d93fde78-643a-45ca-b6e2-75393a845335 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:05.784300 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d93fde78-643a-45ca-b6e2-75393a845335 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:05.923613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d93fde78-643a-45ca-b6e2-75393a845335 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:05.931507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d93fde78-643a-45ca-b6e2-75393a845335 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.161071 Aug 26 18:24:05.932332 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 44/78] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:05 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:06.018590 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-548f047b-dd98-43e9-8c17-be0f39b8af95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:06.019229 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-548f047b-dd98-43e9-8c17-be0f39b8af95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:06.025137 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-548f047b-dd98-43e9-8c17-be0f39b8af95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:06.025609 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-548f047b-dd98-43e9-8c17-be0f39b8af95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:06.026031 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-548f047b-dd98-43e9-8c17-be0f39b8af95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:06.026761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-548f047b-dd98-43e9-8c17-be0f39b8af95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:06.027205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-548f047b-dd98-43e9-8c17-be0f39b8af95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:06.027629 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-548f047b-dd98-43e9-8c17-be0f39b8af95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:06.094242 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-548f047b-dd98-43e9-8c17-be0f39b8af95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:06.103391 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-548f047b-dd98-43e9-8c17-be0f39b8af95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1234 microversion: 2.1 time: 0.088630 Aug 26 18:24:06.104028 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 35/79] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:06 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1234 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:06.312439 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b88044ad-8861-4bc5-90d2-bcc38cb2d563 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:06.313074 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b88044ad-8861-4bc5-90d2-bcc38cb2d563 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:06.319217 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b88044ad-8861-4bc5-90d2-bcc38cb2d563 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:06.319727 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b88044ad-8861-4bc5-90d2-bcc38cb2d563 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:06.320144 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b88044ad-8861-4bc5-90d2-bcc38cb2d563 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:06.321014 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b88044ad-8861-4bc5-90d2-bcc38cb2d563 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:06.321593 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b88044ad-8861-4bc5-90d2-bcc38cb2d563 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:06.322158 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b88044ad-8861-4bc5-90d2-bcc38cb2d563 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:06.388234 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b88044ad-8861-4bc5-90d2-bcc38cb2d563 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:06.399857 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b88044ad-8861-4bc5-90d2-bcc38cb2d563 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:06.401316 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b88044ad-8861-4bc5-90d2-bcc38cb2d563 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:06.402490 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b88044ad-8861-4bc5-90d2-bcc38cb2d563 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1334 microversion: 2.20 time: 0.094180 Aug 26 18:24:06.403016 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 45/80] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:06 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:06.546082 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c2738671-7f1a-4c7a-b8a4-e369f7c2f1fb tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:06.546652 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c2738671-7f1a-4c7a-b8a4-e369f7c2f1fb tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:06.552881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2738671-7f1a-4c7a-b8a4-e369f7c2f1fb tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:06.553381 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2738671-7f1a-4c7a-b8a4-e369f7c2f1fb tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:06.553802 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2738671-7f1a-4c7a-b8a4-e369f7c2f1fb tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:06.554484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2738671-7f1a-4c7a-b8a4-e369f7c2f1fb tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:06.554921 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2738671-7f1a-4c7a-b8a4-e369f7c2f1fb tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:06.555342 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2738671-7f1a-4c7a-b8a4-e369f7c2f1fb tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:06.685291 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c2738671-7f1a-4c7a-b8a4-e369f7c2f1fb tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:06.692984 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c2738671-7f1a-4c7a-b8a4-e369f7c2f1fb tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.150771 Aug 26 18:24:06.693587 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 36/81] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:06 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:06.954183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b712eae7-5a24-45c8-a4cb-67e4b14fb761 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:06.954795 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b712eae7-5a24-45c8-a4cb-67e4b14fb761 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:06.961157 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b712eae7-5a24-45c8-a4cb-67e4b14fb761 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:06.961640 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b712eae7-5a24-45c8-a4cb-67e4b14fb761 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:06.962068 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b712eae7-5a24-45c8-a4cb-67e4b14fb761 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:06.962758 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b712eae7-5a24-45c8-a4cb-67e4b14fb761 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:06.963220 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b712eae7-5a24-45c8-a4cb-67e4b14fb761 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:06.963638 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b712eae7-5a24-45c8-a4cb-67e4b14fb761 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:07.108335 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b712eae7-5a24-45c8-a4cb-67e4b14fb761 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:07.116139 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b712eae7-5a24-45c8-a4cb-67e4b14fb761 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.165919 Aug 26 18:24:07.116752 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 46/82] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:06 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:07.123516 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-65b620d2-03bc-4eb7-a5a5-c51e305506ff tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:07.124130 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-65b620d2-03bc-4eb7-a5a5-c51e305506ff tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:07.130885 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-65b620d2-03bc-4eb7-a5a5-c51e305506ff tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:07.131624 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-65b620d2-03bc-4eb7-a5a5-c51e305506ff tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:07.132281 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-65b620d2-03bc-4eb7-a5a5-c51e305506ff tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:07.133433 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-65b620d2-03bc-4eb7-a5a5-c51e305506ff tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:07.134057 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-65b620d2-03bc-4eb7-a5a5-c51e305506ff tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:07.134532 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-65b620d2-03bc-4eb7-a5a5-c51e305506ff tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:07.202476 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-65b620d2-03bc-4eb7-a5a5-c51e305506ff tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:07.213674 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-65b620d2-03bc-4eb7-a5a5-c51e305506ff tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1234 microversion: 2.1 time: 0.093673 Aug 26 18:24:07.214406 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 37/83] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:07 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1234 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:07.429117 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fe0d6464-e6dd-48c9-a7f8-898f9c836fb2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:07.430127 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fe0d6464-e6dd-48c9-a7f8-898f9c836fb2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:07.437591 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe0d6464-e6dd-48c9-a7f8-898f9c836fb2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:07.438073 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe0d6464-e6dd-48c9-a7f8-898f9c836fb2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:07.438503 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe0d6464-e6dd-48c9-a7f8-898f9c836fb2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:07.439195 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe0d6464-e6dd-48c9-a7f8-898f9c836fb2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:07.439641 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe0d6464-e6dd-48c9-a7f8-898f9c836fb2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:07.440064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe0d6464-e6dd-48c9-a7f8-898f9c836fb2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:07.500999 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fe0d6464-e6dd-48c9-a7f8-898f9c836fb2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:07.509391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fe0d6464-e6dd-48c9-a7f8-898f9c836fb2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:07.510831 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fe0d6464-e6dd-48c9-a7f8-898f9c836fb2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:07.511972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fe0d6464-e6dd-48c9-a7f8-898f9c836fb2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1334 microversion: 2.20 time: 0.089477 Aug 26 18:24:07.513177 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 47/84] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:07 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1334 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:07.717878 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-49d31c62-84f1-4500-9d10-13915b69256b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:07.718843 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-49d31c62-84f1-4500-9d10-13915b69256b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:07.729140 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-49d31c62-84f1-4500-9d10-13915b69256b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:07.730071 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-49d31c62-84f1-4500-9d10-13915b69256b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:07.730496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-49d31c62-84f1-4500-9d10-13915b69256b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:07.731186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-49d31c62-84f1-4500-9d10-13915b69256b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:07.731634 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-49d31c62-84f1-4500-9d10-13915b69256b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:07.732056 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-49d31c62-84f1-4500-9d10-13915b69256b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:07.864219 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-49d31c62-84f1-4500-9d10-13915b69256b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:07.876282 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-49d31c62-84f1-4500-9d10-13915b69256b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.164886 Aug 26 18:24:07.877277 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 38/85] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:07 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:08.140649 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c317867e-02d6-4594-bc8a-001f1ec8920e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:08.141702 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c317867e-02d6-4594-bc8a-001f1ec8920e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:08.151907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c317867e-02d6-4594-bc8a-001f1ec8920e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:08.152456 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c317867e-02d6-4594-bc8a-001f1ec8920e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:08.152932 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c317867e-02d6-4594-bc8a-001f1ec8920e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:08.153664 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c317867e-02d6-4594-bc8a-001f1ec8920e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:08.154117 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c317867e-02d6-4594-bc8a-001f1ec8920e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:08.154543 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c317867e-02d6-4594-bc8a-001f1ec8920e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:08.234668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9cc6db3d-510a-4341-9555-4ed3cf44d4f3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:08.235277 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9cc6db3d-510a-4341-9555-4ed3cf44d4f3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:08.241241 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9cc6db3d-510a-4341-9555-4ed3cf44d4f3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:08.241767 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9cc6db3d-510a-4341-9555-4ed3cf44d4f3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:08.242195 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9cc6db3d-510a-4341-9555-4ed3cf44d4f3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:08.242884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9cc6db3d-510a-4341-9555-4ed3cf44d4f3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:08.243308 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9cc6db3d-510a-4341-9555-4ed3cf44d4f3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:08.243719 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9cc6db3d-510a-4341-9555-4ed3cf44d4f3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:08.282339 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c317867e-02d6-4594-bc8a-001f1ec8920e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:08.290375 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c317867e-02d6-4594-bc8a-001f1ec8920e tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.156499 Aug 26 18:24:08.290953 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 48/86] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:08 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:08.304240 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9cc6db3d-510a-4341-9555-4ed3cf44d4f3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:08.312012 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9cc6db3d-510a-4341-9555-4ed3cf44d4f3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1234 microversion: 2.1 time: 0.081220 Aug 26 18:24:08.312573 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 39/87] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:08 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1234 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:08.536759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-44b62bc0-11d5-4f79-a6a4-f6e3072fe391 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:08.537512 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-44b62bc0-11d5-4f79-a6a4-f6e3072fe391 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:08.544694 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44b62bc0-11d5-4f79-a6a4-f6e3072fe391 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:08.545200 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44b62bc0-11d5-4f79-a6a4-f6e3072fe391 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:08.545631 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44b62bc0-11d5-4f79-a6a4-f6e3072fe391 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:08.546289 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44b62bc0-11d5-4f79-a6a4-f6e3072fe391 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:08.546770 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44b62bc0-11d5-4f79-a6a4-f6e3072fe391 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:08.547191 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44b62bc0-11d5-4f79-a6a4-f6e3072fe391 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:08.611443 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-44b62bc0-11d5-4f79-a6a4-f6e3072fe391 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:08.619581 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-44b62bc0-11d5-4f79-a6a4-f6e3072fe391 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:08.621088 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-44b62bc0-11d5-4f79-a6a4-f6e3072fe391 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:08.622188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-44b62bc0-11d5-4f79-a6a4-f6e3072fe391 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1334 microversion: 2.20 time: 0.090205 Aug 26 18:24:08.622805 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 49/88] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:08 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1334 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:08.901525 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-eb6efc8a-c085-4ba6-8b05-25ca68eb0cb6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:08.902064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-eb6efc8a-c085-4ba6-8b05-25ca68eb0cb6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:08.908399 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb6efc8a-c085-4ba6-8b05-25ca68eb0cb6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:08.908936 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb6efc8a-c085-4ba6-8b05-25ca68eb0cb6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:08.909363 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb6efc8a-c085-4ba6-8b05-25ca68eb0cb6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:08.910054 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb6efc8a-c085-4ba6-8b05-25ca68eb0cb6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:08.910495 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb6efc8a-c085-4ba6-8b05-25ca68eb0cb6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:08.910909 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb6efc8a-c085-4ba6-8b05-25ca68eb0cb6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:09.041062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-eb6efc8a-c085-4ba6-8b05-25ca68eb0cb6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:09.049097 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-eb6efc8a-c085-4ba6-8b05-25ca68eb0cb6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.151680 Aug 26 18:24:09.050379 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 40/89] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:08 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:09.312757 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cde2a0b8-dfb3-481b-9b8f-4b6fe9c46f6a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:09.314781 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cde2a0b8-dfb3-481b-9b8f-4b6fe9c46f6a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:09.328791 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cde2a0b8-dfb3-481b-9b8f-4b6fe9c46f6a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:09.330134 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cde2a0b8-dfb3-481b-9b8f-4b6fe9c46f6a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:09.331927 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cde2a0b8-dfb3-481b-9b8f-4b6fe9c46f6a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:09.334134 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-18ace5b4-4fac-418b-80cd-9e6afe607ee4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:09.334873 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cde2a0b8-dfb3-481b-9b8f-4b6fe9c46f6a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:09.335108 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-18ace5b4-4fac-418b-80cd-9e6afe607ee4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:09.336574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cde2a0b8-dfb3-481b-9b8f-4b6fe9c46f6a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:09.337503 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cde2a0b8-dfb3-481b-9b8f-4b6fe9c46f6a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:09.345404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-18ace5b4-4fac-418b-80cd-9e6afe607ee4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:09.348378 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-18ace5b4-4fac-418b-80cd-9e6afe607ee4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:09.349069 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-18ace5b4-4fac-418b-80cd-9e6afe607ee4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:09.350054 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-18ace5b4-4fac-418b-80cd-9e6afe607ee4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:09.350688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-18ace5b4-4fac-418b-80cd-9e6afe607ee4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:09.352346 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-18ace5b4-4fac-418b-80cd-9e6afe607ee4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:09.542509 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cde2a0b8-dfb3-481b-9b8f-4b6fe9c46f6a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:09.551040 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cde2a0b8-dfb3-481b-9b8f-4b6fe9c46f6a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.243689 Aug 26 18:24:09.551622 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 50/90] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:09 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:09.574974 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-18ace5b4-4fac-418b-80cd-9e6afe607ee4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:09.596381 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-18ace5b4-4fac-418b-80cd-9e6afe607ee4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1234 microversion: 2.1 time: 0.267350 Aug 26 18:24:09.597139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 41/91] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:09 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1234 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:24:09.646718 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-013d390c-22e5-4660-b579-763b3e6210d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:09.647436 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-013d390c-22e5-4660-b579-763b3e6210d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:09.665924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-013d390c-22e5-4660-b579-763b3e6210d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:09.666746 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-013d390c-22e5-4660-b579-763b3e6210d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:09.668862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-013d390c-22e5-4660-b579-763b3e6210d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:09.670925 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-013d390c-22e5-4660-b579-763b3e6210d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:09.672681 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-013d390c-22e5-4660-b579-763b3e6210d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:09.676006 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-013d390c-22e5-4660-b579-763b3e6210d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:09.999478 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:10.041026 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-013d390c-22e5-4660-b579-763b3e6210d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:10.050819 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-013d390c-22e5-4660-b579-763b3e6210d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:10.052492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-013d390c-22e5-4660-b579-763b3e6210d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:10.053818 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-013d390c-22e5-4660-b579-763b3e6210d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1334 microversion: 2.20 time: 0.413198 Aug 26 18:24:10.054699 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 51/92] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:09 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1334 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:10.071369 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-3a694fb1-2b60-4ad6-bff7-d1842c3d8630 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:10.072484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-3a694fb1-2b60-4ad6-bff7-d1842c3d8630 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:10.080871 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a694fb1-2b60-4ad6-bff7-d1842c3d8630 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:10.081354 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a694fb1-2b60-4ad6-bff7-d1842c3d8630 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:10.081777 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a694fb1-2b60-4ad6-bff7-d1842c3d8630 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:10.082551 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a694fb1-2b60-4ad6-bff7-d1842c3d8630 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:10.083077 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a694fb1-2b60-4ad6-bff7-d1842c3d8630 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:10.083540 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a694fb1-2b60-4ad6-bff7-d1842c3d8630 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:10.377779 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=4 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:10.551722 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=10 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:10.576017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f50c966f-7915-40ef-a568-e7900daed31a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:10.576731 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f50c966f-7915-40ef-a568-e7900daed31a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:10.580400 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=22 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:10.596440 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f50c966f-7915-40ef-a568-e7900daed31a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:10.597688 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f50c966f-7915-40ef-a568-e7900daed31a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:10.601159 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f50c966f-7915-40ef-a568-e7900daed31a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:10.604379 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f50c966f-7915-40ef-a568-e7900daed31a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:10.604919 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f50c966f-7915-40ef-a568-e7900daed31a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:10.605544 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f50c966f-7915-40ef-a568-e7900daed31a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:10.798119 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3a694fb1-2b60-4ad6-bff7-d1842c3d8630 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:10.812162 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-3a694fb1-2b60-4ad6-bff7-d1842c3d8630 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.744324 Aug 26 18:24:10.812804 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 42/93] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:10 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:10.835548 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-fb47244d-3761-4ba0-9b5a-6a996daca324 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:10.839245 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-fb47244d-3761-4ba0-9b5a-6a996daca324 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:10.854398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fb47244d-3761-4ba0-9b5a-6a996daca324 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:10.855278 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fb47244d-3761-4ba0-9b5a-6a996daca324 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:10.855867 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fb47244d-3761-4ba0-9b5a-6a996daca324 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:10.856874 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fb47244d-3761-4ba0-9b5a-6a996daca324 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:10.858428 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fb47244d-3761-4ba0-9b5a-6a996daca324 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:10.859051 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fb47244d-3761-4ba0-9b5a-6a996daca324 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:10.923758 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f50c966f-7915-40ef-a568-e7900daed31a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:10.932371 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f50c966f-7915-40ef-a568-e7900daed31a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.364031 Aug 26 18:24:10.933693 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 52/94] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:10 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:10.947193 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-fb47244d-3761-4ba0-9b5a-6a996daca324 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:10.957695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-fb47244d-3761-4ba0-9b5a-6a996daca324 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1296 microversion: 2.1 time: 0.141536 Aug 26 18:24:10.961179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 43/95] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:10 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1296 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:11.080600 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-977fd28a-1731-4e28-b354-fd55fab90a02 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:11.081527 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-977fd28a-1731-4e28-b354-fd55fab90a02 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:11.088618 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-977fd28a-1731-4e28-b354-fd55fab90a02 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:11.091820 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-977fd28a-1731-4e28-b354-fd55fab90a02 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:11.092419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-977fd28a-1731-4e28-b354-fd55fab90a02 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:11.093310 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-977fd28a-1731-4e28-b354-fd55fab90a02 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:11.093941 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-977fd28a-1731-4e28-b354-fd55fab90a02 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:11.094553 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-977fd28a-1731-4e28-b354-fd55fab90a02 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:11.212144 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-977fd28a-1731-4e28-b354-fd55fab90a02 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:11.221520 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-977fd28a-1731-4e28-b354-fd55fab90a02 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:11.223869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-977fd28a-1731-4e28-b354-fd55fab90a02 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:11.225871 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-977fd28a-1731-4e28-b354-fd55fab90a02 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1340 microversion: 2.20 time: 0.148716 Aug 26 18:24:11.227062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 53/96] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:11 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1340 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:11.836545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e71c17d3-8e87-4c93-98cd-b888b0b672bd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:11.837996 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e71c17d3-8e87-4c93-98cd-b888b0b672bd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:11.846822 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e71c17d3-8e87-4c93-98cd-b888b0b672bd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:11.848270 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e71c17d3-8e87-4c93-98cd-b888b0b672bd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:11.849232 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e71c17d3-8e87-4c93-98cd-b888b0b672bd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:11.856210 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e71c17d3-8e87-4c93-98cd-b888b0b672bd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:11.856763 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e71c17d3-8e87-4c93-98cd-b888b0b672bd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:11.857481 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e71c17d3-8e87-4c93-98cd-b888b0b672bd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:11.956251 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7bbb71f7-d285-4b37-956e-acbfd9361cad tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:11.957669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7bbb71f7-d285-4b37-956e-acbfd9361cad tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:11.976363 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7bbb71f7-d285-4b37-956e-acbfd9361cad tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:11.977508 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7bbb71f7-d285-4b37-956e-acbfd9361cad tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:11.978011 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7bbb71f7-d285-4b37-956e-acbfd9361cad tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:11.978801 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7bbb71f7-d285-4b37-956e-acbfd9361cad tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:11.979321 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7bbb71f7-d285-4b37-956e-acbfd9361cad tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:11.979977 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7bbb71f7-d285-4b37-956e-acbfd9361cad tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:12.322178 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7bbb71f7-d285-4b37-956e-acbfd9361cad tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:12.333300 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7bbb71f7-d285-4b37-956e-acbfd9361cad tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.380994 Aug 26 18:24:12.334420 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 54/97] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:11 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:12.356457 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-91c5dfa5-5cf0-449e-bcbf-a4ad858c651c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:12.357761 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-91c5dfa5-5cf0-449e-bcbf-a4ad858c651c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:12.366452 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91c5dfa5-5cf0-449e-bcbf-a4ad858c651c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:12.367174 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91c5dfa5-5cf0-449e-bcbf-a4ad858c651c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:12.367726 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91c5dfa5-5cf0-449e-bcbf-a4ad858c651c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:12.368564 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91c5dfa5-5cf0-449e-bcbf-a4ad858c651c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:12.369703 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91c5dfa5-5cf0-449e-bcbf-a4ad858c651c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:12.370334 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91c5dfa5-5cf0-449e-bcbf-a4ad858c651c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:12.650717 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-91c5dfa5-5cf0-449e-bcbf-a4ad858c651c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:12.667363 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-91c5dfa5-5cf0-449e-bcbf-a4ad858c651c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1363 microversion: 2.1 time: 0.315393 Aug 26 18:24:12.670655 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 55/98] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:12 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:12.682646 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3f0168de-32da-4bcd-8c4b-9533cb4f2b40 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:12.683864 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3f0168de-32da-4bcd-8c4b-9533cb4f2b40 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:12.699527 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f0168de-32da-4bcd-8c4b-9533cb4f2b40 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:12.704014 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f0168de-32da-4bcd-8c4b-9533cb4f2b40 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:12.707564 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f0168de-32da-4bcd-8c4b-9533cb4f2b40 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:12.710527 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f0168de-32da-4bcd-8c4b-9533cb4f2b40 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:12.711813 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f0168de-32da-4bcd-8c4b-9533cb4f2b40 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:12.712392 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f0168de-32da-4bcd-8c4b-9533cb4f2b40 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:12.945773 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e71c17d3-8e87-4c93-98cd-b888b0b672bd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:12.964248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e71c17d3-8e87-4c93-98cd-b888b0b672bd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 1.130527 Aug 26 18:24:12.981478 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 44/99] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:11 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:13.342694 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3f0168de-32da-4bcd-8c4b-9533cb4f2b40 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:13.374884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c6967b22-a7a2-4816-b06f-1aff99a73ba3 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:13.383364 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c6967b22-a7a2-4816-b06f-1aff99a73ba3 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:13.400012 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3f0168de-32da-4bcd-8c4b-9533cb4f2b40 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:13.401936 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3f0168de-32da-4bcd-8c4b-9533cb4f2b40 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:13.403622 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3f0168de-32da-4bcd-8c4b-9533cb4f2b40 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.731714 Aug 26 18:24:13.404395 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 56/100] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:12 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:13.426978 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6967b22-a7a2-4816-b06f-1aff99a73ba3 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:13.427568 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6967b22-a7a2-4816-b06f-1aff99a73ba3 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:13.429040 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6967b22-a7a2-4816-b06f-1aff99a73ba3 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:13.430412 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6967b22-a7a2-4816-b06f-1aff99a73ba3 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:13.432327 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6967b22-a7a2-4816-b06f-1aff99a73ba3 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:13.434197 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6967b22-a7a2-4816-b06f-1aff99a73ba3 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:13.460908 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-cb7a5fe5-373d-4729-90f5-f20f6079b929 req-2eb3eaa0-130a-4403-80f1-788b73debeda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "024e8a0f-0670-4aec-8ec6-e8afbc67d464", "tag": "a2a7330d-44fd-4799-ab35-6c1aa82dab95"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:13.499464 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cb7a5fe5-373d-4729-90f5-f20f6079b929 req-2eb3eaa0-130a-4403-80f1-788b73debeda service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:13.500268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cb7a5fe5-373d-4729-90f5-f20f6079b929 req-2eb3eaa0-130a-4403-80f1-788b73debeda service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:13.501676 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cb7a5fe5-373d-4729-90f5-f20f6079b929 req-2eb3eaa0-130a-4403-80f1-788b73debeda service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:13.524954 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-cb7a5fe5-373d-4729-90f5-f20f6079b929 req-2eb3eaa0-130a-4403-80f1-788b73debeda service nova] Creating event network-changed:a2a7330d-44fd-4799-ab35-6c1aa82dab95 for instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 on hv-cinder-85199 Aug 26 18:24:13.534361 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-cb7a5fe5-373d-4729-90f5-f20f6079b929 req-2eb3eaa0-130a-4403-80f1-788b73debeda service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077950 Aug 26 18:24:13.536302 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 57/101] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:24:13.691408 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ea08bb5e-4124-481c-892a-e17df2b4beed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:13.692801 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ea08bb5e-4124-481c-892a-e17df2b4beed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:13.703997 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea08bb5e-4124-481c-892a-e17df2b4beed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:13.706522 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea08bb5e-4124-481c-892a-e17df2b4beed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:13.708388 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea08bb5e-4124-481c-892a-e17df2b4beed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:13.712465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea08bb5e-4124-481c-892a-e17df2b4beed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:13.721152 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea08bb5e-4124-481c-892a-e17df2b4beed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:13.722131 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea08bb5e-4124-481c-892a-e17df2b4beed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:13.889128 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c6967b22-a7a2-4816-b06f-1aff99a73ba3 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:13.900984 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c6967b22-a7a2-4816-b06f-1aff99a73ba3 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.545326 Aug 26 18:24:13.903013 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 45/102] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:13 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:24:13.984945 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ea08bb5e-4124-481c-892a-e17df2b4beed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:13.988332 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-594ff860-47c3-4477-bfac-0f766d82acee tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:13.989501 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-594ff860-47c3-4477-bfac-0f766d82acee tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:13.993586 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ea08bb5e-4124-481c-892a-e17df2b4beed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1363 microversion: 2.1 time: 0.309133 Aug 26 18:24:13.996927 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 58/103] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:13 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:14.002325 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-594ff860-47c3-4477-bfac-0f766d82acee tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:14.003498 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-594ff860-47c3-4477-bfac-0f766d82acee tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:14.004084 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-594ff860-47c3-4477-bfac-0f766d82acee tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:14.004983 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-594ff860-47c3-4477-bfac-0f766d82acee tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:14.005707 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-594ff860-47c3-4477-bfac-0f766d82acee tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:14.019342 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-594ff860-47c3-4477-bfac-0f766d82acee tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:14.074436 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-74b4a046-9f94-46fa-accd-ffc7b78072f7 req-00a16adc-2cd1-4889-9e81-b738edc0a51f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed32b7d-a792-49b2-84e7-962f4d537501", "tag": "ae3cb7b6-5071-4281-b758-acbb49eab67f"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:14.090293 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-74b4a046-9f94-46fa-accd-ffc7b78072f7 req-00a16adc-2cd1-4889-9e81-b738edc0a51f service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:14.091094 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-74b4a046-9f94-46fa-accd-ffc7b78072f7 req-00a16adc-2cd1-4889-9e81-b738edc0a51f service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:14.092027 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-74b4a046-9f94-46fa-accd-ffc7b78072f7 req-00a16adc-2cd1-4889-9e81-b738edc0a51f service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:14.112490 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-74b4a046-9f94-46fa-accd-ffc7b78072f7 req-00a16adc-2cd1-4889-9e81-b738edc0a51f service nova] Creating event network-changed:ae3cb7b6-5071-4281-b758-acbb49eab67f for instance 1ed32b7d-a792-49b2-84e7-962f4d537501 on hv-cinder-85199 Aug 26 18:24:14.122033 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-74b4a046-9f94-46fa-accd-ffc7b78072f7 req-00a16adc-2cd1-4889-9e81-b738edc0a51f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053801 Aug 26 18:24:14.122958 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 59/104] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:24:14.550396 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-0e2cb510-fc92-4a29-bd0c-89506d93ba68 req-2292ca3c-a679-4381-96c7-f0b6b9613b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88ac3fc-3407-4752-8978-4284558e0cfe", "name": "network-vif-plugged", "status": "completed", "tag": "62f67bf0-ea26-4bf6-a2f2-413adc6e16e0"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:14.564509 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0e2cb510-fc92-4a29-bd0c-89506d93ba68 req-2292ca3c-a679-4381-96c7-f0b6b9613b48 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:14.565155 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0e2cb510-fc92-4a29-bd0c-89506d93ba68 req-2292ca3c-a679-4381-96c7-f0b6b9613b48 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:14.565924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0e2cb510-fc92-4a29-bd0c-89506d93ba68 req-2292ca3c-a679-4381-96c7-f0b6b9613b48 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:14.579916 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-0e2cb510-fc92-4a29-bd0c-89506d93ba68 req-2292ca3c-a679-4381-96c7-f0b6b9613b48 service nova] Creating event network-vif-plugged:62f67bf0-ea26-4bf6-a2f2-413adc6e16e0 for instance c88ac3fc-3407-4752-8978-4284558e0cfe on hv-cinder-85199 Aug 26 18:24:14.596886 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-0e2cb510-fc92-4a29-bd0c-89506d93ba68 req-2292ca3c-a679-4381-96c7-f0b6b9613b48 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183215 Aug 26 18:24:14.597434 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 60/105] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:24:14.610818 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aca462fb-fba8-4333-8ab7-8eb61a5a9210 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:14.611503 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aca462fb-fba8-4333-8ab7-8eb61a5a9210 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:14.627955 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aca462fb-fba8-4333-8ab7-8eb61a5a9210 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:14.629045 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aca462fb-fba8-4333-8ab7-8eb61a5a9210 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:14.631278 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aca462fb-fba8-4333-8ab7-8eb61a5a9210 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:14.632322 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aca462fb-fba8-4333-8ab7-8eb61a5a9210 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:14.633358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aca462fb-fba8-4333-8ab7-8eb61a5a9210 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:14.636086 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aca462fb-fba8-4333-8ab7-8eb61a5a9210 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:14.659902 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-594ff860-47c3-4477-bfac-0f766d82acee tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:14.675655 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-594ff860-47c3-4477-bfac-0f766d82acee tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.691594 Aug 26 18:24:14.676146 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 46/106] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:13 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:24:14.923466 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8250afe0-8286-41fd-97f1-a853f05e8035 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:14.924069 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8250afe0-8286-41fd-97f1-a853f05e8035 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:14.934407 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8250afe0-8286-41fd-97f1-a853f05e8035 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:14.934883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8250afe0-8286-41fd-97f1-a853f05e8035 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:14.935309 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8250afe0-8286-41fd-97f1-a853f05e8035 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:14.940001 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8250afe0-8286-41fd-97f1-a853f05e8035 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:14.940584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8250afe0-8286-41fd-97f1-a853f05e8035 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:14.942595 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8250afe0-8286-41fd-97f1-a853f05e8035 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:14.961527 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-aca462fb-fba8-4333-8ab7-8eb61a5a9210 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:14.964500 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:14.973766 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-aca462fb-fba8-4333-8ab7-8eb61a5a9210 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:14.975952 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-aca462fb-fba8-4333-8ab7-8eb61a5a9210 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:14.977261 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aca462fb-fba8-4333-8ab7-8eb61a5a9210 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.378745 Aug 26 18:24:14.978280 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 61/107] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:14 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:15.015952 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bc65a8a4-7bb7-49b3-a112-f3d3a64518ca tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:15.016780 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bc65a8a4-7bb7-49b3-a112-f3d3a64518ca tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:15.025746 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc65a8a4-7bb7-49b3-a112-f3d3a64518ca tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:15.027758 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc65a8a4-7bb7-49b3-a112-f3d3a64518ca tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:15.028206 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc65a8a4-7bb7-49b3-a112-f3d3a64518ca tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:15.029529 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc65a8a4-7bb7-49b3-a112-f3d3a64518ca tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:15.030489 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc65a8a4-7bb7-49b3-a112-f3d3a64518ca tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:15.031122 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc65a8a4-7bb7-49b3-a112-f3d3a64518ca tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:15.155285 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8250afe0-8286-41fd-97f1-a853f05e8035 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:15.166325 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8250afe0-8286-41fd-97f1-a853f05e8035 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.246798 Aug 26 18:24:15.167621 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 47/108] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:14 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:15.223647 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bc65a8a4-7bb7-49b3-a112-f3d3a64518ca tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:15.236757 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bc65a8a4-7bb7-49b3-a112-f3d3a64518ca tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1363 microversion: 2.1 time: 0.221950 Aug 26 18:24:15.239925 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 62/109] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:15 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:24:15.697440 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-af4f103d-2b7e-46df-91bd-e1e3afe887d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:15.698065 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-af4f103d-2b7e-46df-91bd-e1e3afe887d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:15.736108 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-af4f103d-2b7e-46df-91bd-e1e3afe887d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:15.738189 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-af4f103d-2b7e-46df-91bd-e1e3afe887d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:15.738810 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-af4f103d-2b7e-46df-91bd-e1e3afe887d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:15.739691 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-af4f103d-2b7e-46df-91bd-e1e3afe887d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:15.740436 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-af4f103d-2b7e-46df-91bd-e1e3afe887d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:15.741040 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-af4f103d-2b7e-46df-91bd-e1e3afe887d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:16.003399 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-81265274-3a6b-42d8-a714-65a42832c90e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:16.004008 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-81265274-3a6b-42d8-a714-65a42832c90e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:16.013958 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81265274-3a6b-42d8-a714-65a42832c90e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:16.015106 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81265274-3a6b-42d8-a714-65a42832c90e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:16.016473 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81265274-3a6b-42d8-a714-65a42832c90e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:16.020132 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81265274-3a6b-42d8-a714-65a42832c90e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:16.021164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81265274-3a6b-42d8-a714-65a42832c90e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:16.023073 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81265274-3a6b-42d8-a714-65a42832c90e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:16.433487 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-af4f103d-2b7e-46df-91bd-e1e3afe887d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:16.462050 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-af4f103d-2b7e-46df-91bd-e1e3afe887d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.766999 Aug 26 18:24:16.462820 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 48/110] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:15 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:16.476207 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-08aeb77e-6205-4962-aa4d-87e26f7eaa74 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:16.486935 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-81265274-3a6b-42d8-a714-65a42832c90e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:16.509225 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-08aeb77e-6205-4962-aa4d-87e26f7eaa74 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:16.518526 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-81265274-3a6b-42d8-a714-65a42832c90e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:16.524390 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-81265274-3a6b-42d8-a714-65a42832c90e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:16.528189 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-81265274-3a6b-42d8-a714-65a42832c90e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.526745 Aug 26 18:24:16.530926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 63/111] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:15 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:16.533579 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-08aeb77e-6205-4962-aa4d-87e26f7eaa74 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:16.537063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-08aeb77e-6205-4962-aa4d-87e26f7eaa74 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:16.537505 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-08aeb77e-6205-4962-aa4d-87e26f7eaa74 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:16.538205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-08aeb77e-6205-4962-aa4d-87e26f7eaa74 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:16.541291 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-08aeb77e-6205-4962-aa4d-87e26f7eaa74 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:16.541880 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-08aeb77e-6205-4962-aa4d-87e26f7eaa74 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:16.542633 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-68b96011-34c2-4e82-aa81-a91e8cd1e7d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:16.544609 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-68b96011-34c2-4e82-aa81-a91e8cd1e7d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:16.561308 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68b96011-34c2-4e82-aa81-a91e8cd1e7d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:16.563649 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68b96011-34c2-4e82-aa81-a91e8cd1e7d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:16.564609 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68b96011-34c2-4e82-aa81-a91e8cd1e7d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:16.566076 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68b96011-34c2-4e82-aa81-a91e8cd1e7d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:16.566989 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68b96011-34c2-4e82-aa81-a91e8cd1e7d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:16.567907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68b96011-34c2-4e82-aa81-a91e8cd1e7d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:16.832909 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-68b96011-34c2-4e82-aa81-a91e8cd1e7d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:16.842170 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-68b96011-34c2-4e82-aa81-a91e8cd1e7d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1363 microversion: 2.1 time: 0.309984 Aug 26 18:24:16.842935 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 64/112] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:16 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:16.848203 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-4c4de33a-2644-46a3-a523-a4e277b184d3 req-c0924b97-a886-491f-9d59-a989b5dbc47d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6249cc1c-c171-41b8-81d5-2d73ed7735be", "name": "network-vif-plugged", "status": "completed", "tag": "bac5114e-f74f-4b09-9068-4de5433c0fdf"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:16.860580 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-4c4de33a-2644-46a3-a523-a4e277b184d3 req-c0924b97-a886-491f-9d59-a989b5dbc47d service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:16.861405 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-4c4de33a-2644-46a3-a523-a4e277b184d3 req-c0924b97-a886-491f-9d59-a989b5dbc47d service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:16.862049 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-4c4de33a-2644-46a3-a523-a4e277b184d3 req-c0924b97-a886-491f-9d59-a989b5dbc47d service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:16.875677 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-08aeb77e-6205-4962-aa4d-87e26f7eaa74 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:16.880980 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-4c4de33a-2644-46a3-a523-a4e277b184d3 req-c0924b97-a886-491f-9d59-a989b5dbc47d service nova] Creating event network-vif-plugged:bac5114e-f74f-4b09-9068-4de5433c0fdf for instance 6249cc1c-c171-41b8-81d5-2d73ed7735be on hv-cinder-85199 Aug 26 18:24:16.888009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-4c4de33a-2644-46a3-a523-a4e277b184d3 req-c0924b97-a886-491f-9d59-a989b5dbc47d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043058 Aug 26 18:24:16.891156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-08aeb77e-6205-4962-aa4d-87e26f7eaa74 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.418892 Aug 26 18:24:16.891721 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 49/113] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:16 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:16.894159 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 65/114] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:24:17.482998 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2d06b5da-772f-49ff-b407-b7ec88658dda tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:17.484372 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2d06b5da-772f-49ff-b407-b7ec88658dda tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:17.494913 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d06b5da-772f-49ff-b407-b7ec88658dda tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:17.495755 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d06b5da-772f-49ff-b407-b7ec88658dda tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:17.496501 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d06b5da-772f-49ff-b407-b7ec88658dda tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:17.497534 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d06b5da-772f-49ff-b407-b7ec88658dda tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:17.498190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d06b5da-772f-49ff-b407-b7ec88658dda tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:17.498663 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d06b5da-772f-49ff-b407-b7ec88658dda tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:17.512908 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=100 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:17.555941 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3632b54e-a2ce-49c2-81cd-ed31f280d5a5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:17.556639 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3632b54e-a2ce-49c2-81cd-ed31f280d5a5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:17.570679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3632b54e-a2ce-49c2-81cd-ed31f280d5a5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:17.574682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3632b54e-a2ce-49c2-81cd-ed31f280d5a5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:17.575297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3632b54e-a2ce-49c2-81cd-ed31f280d5a5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:17.576192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3632b54e-a2ce-49c2-81cd-ed31f280d5a5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:17.576814 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3632b54e-a2ce-49c2-81cd-ed31f280d5a5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:17.577247 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3632b54e-a2ce-49c2-81cd-ed31f280d5a5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:17.736482 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2d06b5da-772f-49ff-b407-b7ec88658dda tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:17.746078 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2d06b5da-772f-49ff-b407-b7ec88658dda tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.266807 Aug 26 18:24:17.747525 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 50/115] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:17 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:17.780357 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3632b54e-a2ce-49c2-81cd-ed31f280d5a5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:17.790483 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3632b54e-a2ce-49c2-81cd-ed31f280d5a5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:17.792109 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3632b54e-a2ce-49c2-81cd-ed31f280d5a5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:17.793502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3632b54e-a2ce-49c2-81cd-ed31f280d5a5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.242745 Aug 26 18:24:17.798115 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 66/116] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:17 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:24:17.863802 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8d4e4b41-1c3b-46a5-a376-3ffb05919341 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:17.864405 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8d4e4b41-1c3b-46a5-a376-3ffb05919341 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:17.879915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8d4e4b41-1c3b-46a5-a376-3ffb05919341 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:17.879915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8d4e4b41-1c3b-46a5-a376-3ffb05919341 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:17.879915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8d4e4b41-1c3b-46a5-a376-3ffb05919341 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:17.879915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8d4e4b41-1c3b-46a5-a376-3ffb05919341 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:17.880516 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8d4e4b41-1c3b-46a5-a376-3ffb05919341 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:17.880516 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8d4e4b41-1c3b-46a5-a376-3ffb05919341 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:17.911666 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d2175a3d-8e6e-4c31-af79-221b83788ffc tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:17.912268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d2175a3d-8e6e-4c31-af79-221b83788ffc tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:17.921719 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2175a3d-8e6e-4c31-af79-221b83788ffc tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:17.922466 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2175a3d-8e6e-4c31-af79-221b83788ffc tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:17.923739 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2175a3d-8e6e-4c31-af79-221b83788ffc tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:17.925655 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2175a3d-8e6e-4c31-af79-221b83788ffc tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:17.926452 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2175a3d-8e6e-4c31-af79-221b83788ffc tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:17.927054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2175a3d-8e6e-4c31-af79-221b83788ffc tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:18.084489 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d2175a3d-8e6e-4c31-af79-221b83788ffc tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:18.097820 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d2175a3d-8e6e-4c31-af79-221b83788ffc tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.189890 Aug 26 18:24:18.099389 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 67/117] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:17 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:24:18.114420 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8d4e4b41-1c3b-46a5-a376-3ffb05919341 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:18.124517 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8d4e4b41-1c3b-46a5-a376-3ffb05919341 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1363 microversion: 2.1 time: 0.263347 Aug 26 18:24:18.124517 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 51/118] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:17 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:24:18.768581 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6baa1266-ad66-4891-ab48-38bc3c0315b3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:18.769444 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6baa1266-ad66-4891-ab48-38bc3c0315b3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:18.775772 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6baa1266-ad66-4891-ab48-38bc3c0315b3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:18.776274 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6baa1266-ad66-4891-ab48-38bc3c0315b3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:18.777099 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6baa1266-ad66-4891-ab48-38bc3c0315b3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:18.777788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6baa1266-ad66-4891-ab48-38bc3c0315b3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:18.778283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6baa1266-ad66-4891-ab48-38bc3c0315b3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:18.778668 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6baa1266-ad66-4891-ab48-38bc3c0315b3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:18.825173 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-38194786-5321-47ea-b606-f27cd38831c7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:18.825794 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-38194786-5321-47ea-b606-f27cd38831c7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:18.835979 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-38194786-5321-47ea-b606-f27cd38831c7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:18.836667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-38194786-5321-47ea-b606-f27cd38831c7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:18.837292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-38194786-5321-47ea-b606-f27cd38831c7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:18.838247 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-38194786-5321-47ea-b606-f27cd38831c7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:18.839535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-38194786-5321-47ea-b606-f27cd38831c7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:18.841458 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-38194786-5321-47ea-b606-f27cd38831c7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:18.980706 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6baa1266-ad66-4891-ab48-38bc3c0315b3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:18.997975 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6baa1266-ad66-4891-ab48-38bc3c0315b3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.233442 Aug 26 18:24:18.999940 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 68/119] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:18 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:19.025217 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-38194786-5321-47ea-b606-f27cd38831c7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:19.040512 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-38194786-5321-47ea-b606-f27cd38831c7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:19.042010 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-38194786-5321-47ea-b606-f27cd38831c7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:19.043193 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-38194786-5321-47ea-b606-f27cd38831c7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.223741 Aug 26 18:24:19.043753 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 52/120] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:18 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:19.119264 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b78c0b32-00d1-44e7-9826-59136334bf7c tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:19.120012 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b78c0b32-00d1-44e7-9826-59136334bf7c tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:19.126303 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b78c0b32-00d1-44e7-9826-59136334bf7c tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:19.126897 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b78c0b32-00d1-44e7-9826-59136334bf7c tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:19.127382 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b78c0b32-00d1-44e7-9826-59136334bf7c tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:19.128080 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b78c0b32-00d1-44e7-9826-59136334bf7c tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:19.128534 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b78c0b32-00d1-44e7-9826-59136334bf7c tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:19.129084 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b78c0b32-00d1-44e7-9826-59136334bf7c tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:19.142741 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-26f15879-978a-4911-b1ec-5a0d09220dc3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:19.143348 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-26f15879-978a-4911-b1ec-5a0d09220dc3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:19.151298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-26f15879-978a-4911-b1ec-5a0d09220dc3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:19.151799 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-26f15879-978a-4911-b1ec-5a0d09220dc3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:19.152275 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-26f15879-978a-4911-b1ec-5a0d09220dc3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:19.153062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-26f15879-978a-4911-b1ec-5a0d09220dc3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:19.156829 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-26f15879-978a-4911-b1ec-5a0d09220dc3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:19.157287 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-26f15879-978a-4911-b1ec-5a0d09220dc3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:19.313622 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-26f15879-978a-4911-b1ec-5a0d09220dc3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:19.324924 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-26f15879-978a-4911-b1ec-5a0d09220dc3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1363 microversion: 2.1 time: 0.185731 Aug 26 18:24:19.326131 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 53/121] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:19 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:19.347069 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b78c0b32-00d1-44e7-9826-59136334bf7c tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:19.355933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b78c0b32-00d1-44e7-9826-59136334bf7c tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.240633 Aug 26 18:24:19.356485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 69/122] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:19 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:19.868306 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-6cfba9ca-2e24-4797-9720-f1e0f3b314c1 req-a9b6dae3-5115-4342-88f5-f09b8e4280bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6262b31b-ccd3-40d7-8258-7414e80e5893", "name": "network-vif-plugged", "status": "completed", "tag": "ac74a58e-fb20-452c-9734-c6b8f5f60492"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:19.880053 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-6cfba9ca-2e24-4797-9720-f1e0f3b314c1 req-a9b6dae3-5115-4342-88f5-f09b8e4280bf service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:19.880768 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-6cfba9ca-2e24-4797-9720-f1e0f3b314c1 req-a9b6dae3-5115-4342-88f5-f09b8e4280bf service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:19.881384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-6cfba9ca-2e24-4797-9720-f1e0f3b314c1 req-a9b6dae3-5115-4342-88f5-f09b8e4280bf service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:19.896641 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-6cfba9ca-2e24-4797-9720-f1e0f3b314c1 req-a9b6dae3-5115-4342-88f5-f09b8e4280bf service nova] Creating event network-vif-plugged:ac74a58e-fb20-452c-9734-c6b8f5f60492 for instance 6262b31b-ccd3-40d7-8258-7414e80e5893 on hv-cinder-85199 Aug 26 18:24:19.902308 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-6cfba9ca-2e24-4797-9720-f1e0f3b314c1 req-a9b6dae3-5115-4342-88f5-f09b8e4280bf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037786 Aug 26 18:24:19.903298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 54/123] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:24:20.018396 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-49565279-5e9e-45e0-8b09-514c3e491284 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:20.019290 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-49565279-5e9e-45e0-8b09-514c3e491284 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:20.025652 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49565279-5e9e-45e0-8b09-514c3e491284 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:20.026251 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49565279-5e9e-45e0-8b09-514c3e491284 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:20.026752 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49565279-5e9e-45e0-8b09-514c3e491284 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:20.027657 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49565279-5e9e-45e0-8b09-514c3e491284 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:20.028359 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49565279-5e9e-45e0-8b09-514c3e491284 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:20.028986 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49565279-5e9e-45e0-8b09-514c3e491284 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:20.078408 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f8bd3644-0ecf-41dd-bdd8-d5b145fa229e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:20.080326 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f8bd3644-0ecf-41dd-bdd8-d5b145fa229e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:20.095549 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f8bd3644-0ecf-41dd-bdd8-d5b145fa229e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:20.096752 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f8bd3644-0ecf-41dd-bdd8-d5b145fa229e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:20.103352 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f8bd3644-0ecf-41dd-bdd8-d5b145fa229e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:20.104337 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f8bd3644-0ecf-41dd-bdd8-d5b145fa229e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:20.105646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f8bd3644-0ecf-41dd-bdd8-d5b145fa229e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:20.106291 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f8bd3644-0ecf-41dd-bdd8-d5b145fa229e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:20.258462 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-49565279-5e9e-45e0-8b09-514c3e491284 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:20.273004 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-49565279-5e9e-45e0-8b09-514c3e491284 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.254870 Aug 26 18:24:20.273868 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 70/124] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:20 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:20.332002 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f8bd3644-0ecf-41dd-bdd8-d5b145fa229e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:20.341921 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f8bd3644-0ecf-41dd-bdd8-d5b145fa229e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:20.343717 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f8bd3644-0ecf-41dd-bdd8-d5b145fa229e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:20.345100 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f8bd3644-0ecf-41dd-bdd8-d5b145fa229e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.277480 Aug 26 18:24:20.346187 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 55/125] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:20 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:20.348280 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6cf749e6-a1be-48ba-a927-2e32ecb29781 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:20.349329 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6cf749e6-a1be-48ba-a927-2e32ecb29781 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:20.355652 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cf749e6-a1be-48ba-a927-2e32ecb29781 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:20.356148 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cf749e6-a1be-48ba-a927-2e32ecb29781 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:20.357161 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cf749e6-a1be-48ba-a927-2e32ecb29781 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:20.358347 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cf749e6-a1be-48ba-a927-2e32ecb29781 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:20.359193 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cf749e6-a1be-48ba-a927-2e32ecb29781 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:20.360039 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cf749e6-a1be-48ba-a927-2e32ecb29781 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:20.377324 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-bf2efd57-1eb9-48c6-b8db-9b8f5ff40d53 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:20.378164 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-bf2efd57-1eb9-48c6-b8db-9b8f5ff40d53 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:20.387164 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bf2efd57-1eb9-48c6-b8db-9b8f5ff40d53 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:20.388157 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bf2efd57-1eb9-48c6-b8db-9b8f5ff40d53 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:20.388861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bf2efd57-1eb9-48c6-b8db-9b8f5ff40d53 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:20.389807 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bf2efd57-1eb9-48c6-b8db-9b8f5ff40d53 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:20.390541 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bf2efd57-1eb9-48c6-b8db-9b8f5ff40d53 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:20.391341 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bf2efd57-1eb9-48c6-b8db-9b8f5ff40d53 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:20.590961 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6cf749e6-a1be-48ba-a927-2e32ecb29781 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:20.605959 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6cf749e6-a1be-48ba-a927-2e32ecb29781 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1363 microversion: 2.1 time: 0.263438 Aug 26 18:24:20.606569 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 71/126] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:20 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:20.729983 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-bf2efd57-1eb9-48c6-b8db-9b8f5ff40d53 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:20.745264 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-bf2efd57-1eb9-48c6-b8db-9b8f5ff40d53 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.372550 Aug 26 18:24:20.753857 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 56/127] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:20 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:21.293976 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b35027e4-6872-466d-91ae-9e49a434e95c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:21.294515 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b35027e4-6872-466d-91ae-9e49a434e95c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:21.300579 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b35027e4-6872-466d-91ae-9e49a434e95c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:21.301070 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b35027e4-6872-466d-91ae-9e49a434e95c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:21.301526 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b35027e4-6872-466d-91ae-9e49a434e95c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:21.302174 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b35027e4-6872-466d-91ae-9e49a434e95c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:21.302622 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b35027e4-6872-466d-91ae-9e49a434e95c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:21.303050 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b35027e4-6872-466d-91ae-9e49a434e95c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:21.369654 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d01780f9-22fc-4bf7-acc9-676080605812 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:21.370244 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-d01780f9-22fc-4bf7-acc9-676080605812 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:21.377612 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d01780f9-22fc-4bf7-acc9-676080605812 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:21.378500 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d01780f9-22fc-4bf7-acc9-676080605812 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:21.379384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d01780f9-22fc-4bf7-acc9-676080605812 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:21.380437 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d01780f9-22fc-4bf7-acc9-676080605812 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:21.381069 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d01780f9-22fc-4bf7-acc9-676080605812 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:21.381828 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d01780f9-22fc-4bf7-acc9-676080605812 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:21.444124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b35027e4-6872-466d-91ae-9e49a434e95c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:21.452931 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b35027e4-6872-466d-91ae-9e49a434e95c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.162982 Aug 26 18:24:21.453682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 72/128] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:21 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:21.526599 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d01780f9-22fc-4bf7-acc9-676080605812 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:21.534817 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d01780f9-22fc-4bf7-acc9-676080605812 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:21.536310 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d01780f9-22fc-4bf7-acc9-676080605812 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:21.537459 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-d01780f9-22fc-4bf7-acc9-676080605812 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.172212 Aug 26 18:24:21.538027 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 57/129] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:21 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:24:21.626718 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8dcadc7f-e750-4339-82d1-be42bc8b75ea tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:21.627315 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8dcadc7f-e750-4339-82d1-be42bc8b75ea tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:21.633919 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dcadc7f-e750-4339-82d1-be42bc8b75ea tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:21.634528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dcadc7f-e750-4339-82d1-be42bc8b75ea tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:21.635050 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dcadc7f-e750-4339-82d1-be42bc8b75ea tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:21.635890 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dcadc7f-e750-4339-82d1-be42bc8b75ea tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:21.636543 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dcadc7f-e750-4339-82d1-be42bc8b75ea tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:21.637114 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dcadc7f-e750-4339-82d1-be42bc8b75ea tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:21.779521 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8dcadc7f-e750-4339-82d1-be42bc8b75ea tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:21.783155 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-16a5f070-425a-4425-8c45-3ed1394364c1 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:21.785746 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-16a5f070-425a-4425-8c45-3ed1394364c1 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:21.794991 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8dcadc7f-e750-4339-82d1-be42bc8b75ea tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1363 microversion: 2.1 time: 0.171990 Aug 26 18:24:21.797254 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-16a5f070-425a-4425-8c45-3ed1394364c1 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:21.797734 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-16a5f070-425a-4425-8c45-3ed1394364c1 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:21.798158 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-16a5f070-425a-4425-8c45-3ed1394364c1 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:21.798331 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 73/130] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:21 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:21.799276 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-16a5f070-425a-4425-8c45-3ed1394364c1 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:21.799866 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-16a5f070-425a-4425-8c45-3ed1394364c1 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:21.800893 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-16a5f070-425a-4425-8c45-3ed1394364c1 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:21.950254 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-16a5f070-425a-4425-8c45-3ed1394364c1 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:21.960283 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-16a5f070-425a-4425-8c45-3ed1394364c1 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.189354 Aug 26 18:24:21.975025 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 58/131] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:21 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:24:22.475498 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-985843a2-f3d7-427a-8b4a-166726ace2db tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:22.476293 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-985843a2-f3d7-427a-8b4a-166726ace2db tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:22.483403 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-985843a2-f3d7-427a-8b4a-166726ace2db tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:22.483907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-985843a2-f3d7-427a-8b4a-166726ace2db tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:22.484479 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-985843a2-f3d7-427a-8b4a-166726ace2db tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:22.485506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-985843a2-f3d7-427a-8b4a-166726ace2db tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:22.486080 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-985843a2-f3d7-427a-8b4a-166726ace2db tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:22.486600 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-985843a2-f3d7-427a-8b4a-166726ace2db tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:22.560989 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-3fad4815-ce1c-4a30-802c-0820b2b3ab7c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:22.561602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-3fad4815-ce1c-4a30-802c-0820b2b3ab7c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:22.570586 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3fad4815-ce1c-4a30-802c-0820b2b3ab7c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:22.571079 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3fad4815-ce1c-4a30-802c-0820b2b3ab7c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:22.571533 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3fad4815-ce1c-4a30-802c-0820b2b3ab7c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:22.575240 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3fad4815-ce1c-4a30-802c-0820b2b3ab7c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:22.575899 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3fad4815-ce1c-4a30-802c-0820b2b3ab7c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:22.577846 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3fad4815-ce1c-4a30-802c-0820b2b3ab7c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:22.651509 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-985843a2-f3d7-427a-8b4a-166726ace2db tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:22.660195 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-985843a2-f3d7-427a-8b4a-166726ace2db tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.189768 Aug 26 18:24:22.660794 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 74/132] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:22 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:22.761643 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3fad4815-ce1c-4a30-802c-0820b2b3ab7c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:22.771353 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3fad4815-ce1c-4a30-802c-0820b2b3ab7c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:22.773126 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3fad4815-ce1c-4a30-802c-0820b2b3ab7c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:22.774612 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-3fad4815-ce1c-4a30-802c-0820b2b3ab7c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.218621 Aug 26 18:24:22.775219 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 59/133] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:22 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:22.815475 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7db60013-1d5c-4ad5-bde9-b74e1ca83b6b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:22.816104 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7db60013-1d5c-4ad5-bde9-b74e1ca83b6b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:22.822320 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7db60013-1d5c-4ad5-bde9-b74e1ca83b6b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:22.822965 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7db60013-1d5c-4ad5-bde9-b74e1ca83b6b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:22.823370 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7db60013-1d5c-4ad5-bde9-b74e1ca83b6b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:22.824091 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7db60013-1d5c-4ad5-bde9-b74e1ca83b6b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:22.824535 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7db60013-1d5c-4ad5-bde9-b74e1ca83b6b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:22.824971 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7db60013-1d5c-4ad5-bde9-b74e1ca83b6b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:22.955724 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7db60013-1d5c-4ad5-bde9-b74e1ca83b6b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:22.964475 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7db60013-1d5c-4ad5-bde9-b74e1ca83b6b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1363 microversion: 2.1 time: 0.152718 Aug 26 18:24:22.965060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 75/134] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:22 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:22.982859 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-5576b4a6-fade-476e-8409-23f478bbf458 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:22.983790 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-5576b4a6-fade-476e-8409-23f478bbf458 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:22.990352 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5576b4a6-fade-476e-8409-23f478bbf458 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:22.990843 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5576b4a6-fade-476e-8409-23f478bbf458 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:22.991616 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5576b4a6-fade-476e-8409-23f478bbf458 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:22.992457 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5576b4a6-fade-476e-8409-23f478bbf458 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:22.993273 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5576b4a6-fade-476e-8409-23f478bbf458 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:22.993639 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5576b4a6-fade-476e-8409-23f478bbf458 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:23.148365 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5576b4a6-fade-476e-8409-23f478bbf458 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:23.157731 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-5576b4a6-fade-476e-8409-23f478bbf458 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1314 microversion: 2.1 time: 0.179410 Aug 26 18:24:23.158610 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 60/135] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:22 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:23.680743 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1e5eaeb1-cf04-4904-aafd-5d8c9a122cd2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:23.681448 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1e5eaeb1-cf04-4904-aafd-5d8c9a122cd2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:23.687846 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e5eaeb1-cf04-4904-aafd-5d8c9a122cd2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:23.688334 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e5eaeb1-cf04-4904-aafd-5d8c9a122cd2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:23.688781 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e5eaeb1-cf04-4904-aafd-5d8c9a122cd2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:23.689475 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e5eaeb1-cf04-4904-aafd-5d8c9a122cd2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:23.689924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e5eaeb1-cf04-4904-aafd-5d8c9a122cd2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:23.690343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e5eaeb1-cf04-4904-aafd-5d8c9a122cd2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:23.797408 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-854350fb-c3ac-4aa1-bdf5-4e4dd1370dc3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:23.798092 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-854350fb-c3ac-4aa1-bdf5-4e4dd1370dc3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:23.804707 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-854350fb-c3ac-4aa1-bdf5-4e4dd1370dc3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:23.805675 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-854350fb-c3ac-4aa1-bdf5-4e4dd1370dc3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:23.806198 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-854350fb-c3ac-4aa1-bdf5-4e4dd1370dc3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:23.806954 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-854350fb-c3ac-4aa1-bdf5-4e4dd1370dc3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:23.807723 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-854350fb-c3ac-4aa1-bdf5-4e4dd1370dc3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:23.808361 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-854350fb-c3ac-4aa1-bdf5-4e4dd1370dc3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:23.823804 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1e5eaeb1-cf04-4904-aafd-5d8c9a122cd2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:23.835814 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1e5eaeb1-cf04-4904-aafd-5d8c9a122cd2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.158995 Aug 26 18:24:23.840880 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 76/136] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:23 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:23.955227 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-854350fb-c3ac-4aa1-bdf5-4e4dd1370dc3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:23.964424 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-854350fb-c3ac-4aa1-bdf5-4e4dd1370dc3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:23.966165 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-854350fb-c3ac-4aa1-bdf5-4e4dd1370dc3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:23.967272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-854350fb-c3ac-4aa1-bdf5-4e4dd1370dc3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.174325 Aug 26 18:24:23.968181 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 61/137] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:23 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:24:23.985754 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f19fdbd3-fbe5-4590-9fa3-7e3eff3087d6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:23.986462 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f19fdbd3-fbe5-4590-9fa3-7e3eff3087d6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:23.992595 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f19fdbd3-fbe5-4590-9fa3-7e3eff3087d6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:23.993457 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f19fdbd3-fbe5-4590-9fa3-7e3eff3087d6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:23.993834 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f19fdbd3-fbe5-4590-9fa3-7e3eff3087d6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:23.994531 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f19fdbd3-fbe5-4590-9fa3-7e3eff3087d6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:23.995164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f19fdbd3-fbe5-4590-9fa3-7e3eff3087d6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:23.995588 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f19fdbd3-fbe5-4590-9fa3-7e3eff3087d6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:24.158112 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f19fdbd3-fbe5-4590-9fa3-7e3eff3087d6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:24.167455 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f19fdbd3-fbe5-4590-9fa3-7e3eff3087d6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1363 microversion: 2.1 time: 0.185779 Aug 26 18:24:24.168093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 77/138] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:23 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:24.186657 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-00ab653c-b865-4bdf-a9c9-d48860ee9c60 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:24.187178 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-00ab653c-b865-4bdf-a9c9-d48860ee9c60 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:24.189426 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:24.203048 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-00ab653c-b865-4bdf-a9c9-d48860ee9c60 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:24.203542 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-00ab653c-b865-4bdf-a9c9-d48860ee9c60 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:24.203966 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-00ab653c-b865-4bdf-a9c9-d48860ee9c60 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:24.204665 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-00ab653c-b865-4bdf-a9c9-d48860ee9c60 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:24.205346 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-00ab653c-b865-4bdf-a9c9-d48860ee9c60 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:24.205763 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-00ab653c-b865-4bdf-a9c9-d48860ee9c60 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:24.360703 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-00ab653c-b865-4bdf-a9c9-d48860ee9c60 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:24.369522 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-00ab653c-b865-4bdf-a9c9-d48860ee9c60 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1500 microversion: 2.1 time: 0.186867 Aug 26 18:24:24.370168 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 62/139] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:24 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1500 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:24.859074 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-142df28e-6cfd-45c2-ae18-104fe254c5a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:24.860543 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-142df28e-6cfd-45c2-ae18-104fe254c5a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:24.867508 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-142df28e-6cfd-45c2-ae18-104fe254c5a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:24.868011 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-142df28e-6cfd-45c2-ae18-104fe254c5a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:24.868658 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-142df28e-6cfd-45c2-ae18-104fe254c5a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:24.869385 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-142df28e-6cfd-45c2-ae18-104fe254c5a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:24.870053 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-142df28e-6cfd-45c2-ae18-104fe254c5a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:24.870466 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-142df28e-6cfd-45c2-ae18-104fe254c5a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:24.991155 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-aec5899f-d416-47b5-8c1f-8b1f4de3bba4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:24.991700 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-aec5899f-d416-47b5-8c1f-8b1f4de3bba4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:24.998199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aec5899f-d416-47b5-8c1f-8b1f4de3bba4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:24.998948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aec5899f-d416-47b5-8c1f-8b1f4de3bba4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:24.999713 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aec5899f-d416-47b5-8c1f-8b1f4de3bba4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:25.000555 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aec5899f-d416-47b5-8c1f-8b1f4de3bba4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:25.001094 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aec5899f-d416-47b5-8c1f-8b1f4de3bba4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:25.001583 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aec5899f-d416-47b5-8c1f-8b1f4de3bba4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:25.007307 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-142df28e-6cfd-45c2-ae18-104fe254c5a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:25.016968 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-142df28e-6cfd-45c2-ae18-104fe254c5a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1322 microversion: 2.1 time: 0.163519 Aug 26 18:24:25.025763 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 78/140] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:24 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:25.161163 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-aec5899f-d416-47b5-8c1f-8b1f4de3bba4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:25.170706 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-aec5899f-d416-47b5-8c1f-8b1f4de3bba4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:25.172704 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-aec5899f-d416-47b5-8c1f-8b1f4de3bba4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:25.174379 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-aec5899f-d416-47b5-8c1f-8b1f4de3bba4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.188037 Aug 26 18:24:25.187055 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 63/141] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:24 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:25.192951 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ec170c5b-ca48-4b10-b1f0-5b4a631c29cd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:25.193565 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ec170c5b-ca48-4b10-b1f0-5b4a631c29cd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:25.204011 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec170c5b-ca48-4b10-b1f0-5b4a631c29cd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:25.204827 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec170c5b-ca48-4b10-b1f0-5b4a631c29cd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:25.206379 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec170c5b-ca48-4b10-b1f0-5b4a631c29cd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:25.207583 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec170c5b-ca48-4b10-b1f0-5b4a631c29cd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:25.208300 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec170c5b-ca48-4b10-b1f0-5b4a631c29cd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:25.209144 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec170c5b-ca48-4b10-b1f0-5b4a631c29cd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:25.232291 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:25.406742 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ec170c5b-ca48-4b10-b1f0-5b4a631c29cd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:25.415727 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ec170c5b-ca48-4b10-b1f0-5b4a631c29cd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1363 microversion: 2.1 time: 0.227896 Aug 26 18:24:25.417156 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 79/142] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:25 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:24:26.038167 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-3aa7cfe5-5f63-4aaa-92cd-f936b01e016e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:26.038749 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-3aa7cfe5-5f63-4aaa-92cd-f936b01e016e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:26.045123 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3aa7cfe5-5f63-4aaa-92cd-f936b01e016e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:26.045607 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3aa7cfe5-5f63-4aaa-92cd-f936b01e016e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:26.046031 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3aa7cfe5-5f63-4aaa-92cd-f936b01e016e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:26.046727 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3aa7cfe5-5f63-4aaa-92cd-f936b01e016e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:26.047151 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3aa7cfe5-5f63-4aaa-92cd-f936b01e016e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:26.047589 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3aa7cfe5-5f63-4aaa-92cd-f936b01e016e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:26.193975 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3aa7cfe5-5f63-4aaa-92cd-f936b01e016e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:26.203931 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f082829c-d698-40d0-9170-70993282bbb6 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:26.204547 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f082829c-d698-40d0-9170-70993282bbb6 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:26.211095 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f082829c-d698-40d0-9170-70993282bbb6 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:26.211770 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-3aa7cfe5-5f63-4aaa-92cd-f936b01e016e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1517 microversion: 2.1 time: 0.177454 Aug 26 18:24:26.211898 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f082829c-d698-40d0-9170-70993282bbb6 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:26.212230 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f082829c-d698-40d0-9170-70993282bbb6 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:26.212338 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 64/143] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:26 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:26.215074 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f082829c-d698-40d0-9170-70993282bbb6 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:26.215608 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f082829c-d698-40d0-9170-70993282bbb6 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:26.216153 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f082829c-d698-40d0-9170-70993282bbb6 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:26.233005 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2c3ddc52-bcdc-4cc5-a072-2cf1762b3384 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:26.235282 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2c3ddc52-bcdc-4cc5-a072-2cf1762b3384 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:26.242489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2c3ddc52-bcdc-4cc5-a072-2cf1762b3384 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:26.243232 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2c3ddc52-bcdc-4cc5-a072-2cf1762b3384 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:26.243823 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2c3ddc52-bcdc-4cc5-a072-2cf1762b3384 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:26.244673 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2c3ddc52-bcdc-4cc5-a072-2cf1762b3384 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:26.245285 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2c3ddc52-bcdc-4cc5-a072-2cf1762b3384 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:26.245908 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2c3ddc52-bcdc-4cc5-a072-2cf1762b3384 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:26.315554 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-2c3ddc52-bcdc-4cc5-a072-2cf1762b3384 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lazy-loading 'flavor' on Instance uuid 6262b31b-ccd3-40d7-8258-7414e80e5893 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:24:26.369712 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f082829c-d698-40d0-9170-70993282bbb6 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:26.383908 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f082829c-d698-40d0-9170-70993282bbb6 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:26.385490 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f082829c-d698-40d0-9170-70993282bbb6 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:26.387754 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f082829c-d698-40d0-9170-70993282bbb6 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.191100 Aug 26 18:24:26.388944 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 80/144] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:26 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:26.394279 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0c16419d-6887-48d4-8c9a-61ed48575773 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "583f1114-4cff-4c25-bac2-0f91c1295fdb"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:26.396701 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0c16419d-6887-48d4-8c9a-61ed48575773 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:26.404311 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c16419d-6887-48d4-8c9a-61ed48575773 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:26.406993 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c16419d-6887-48d4-8c9a-61ed48575773 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:26.407439 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c16419d-6887-48d4-8c9a-61ed48575773 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:26.408147 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c16419d-6887-48d4-8c9a-61ed48575773 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:26.408596 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c16419d-6887-48d4-8c9a-61ed48575773 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:26.409050 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c16419d-6887-48d4-8c9a-61ed48575773 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:26.415068 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:26.440961 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2c3ddc52-bcdc-4cc5-a072-2cf1762b3384 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "POST /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893/action" status: 200 len: 32 microversion: 2.1 time: 0.211920 Aug 26 18:24:26.441559 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 65/145] 10.222.0.45 () {60 vars in 1278 bytes} [Fri Aug 26 18:24:26 2022] POST /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893/action => generated 32 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 18:24:26.447038 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ddbe9b5a-283f-43e1-9309-dd6f36bb7cfb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:26.447721 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ddbe9b5a-283f-43e1-9309-dd6f36bb7cfb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:26.453853 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ddbe9b5a-283f-43e1-9309-dd6f36bb7cfb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:26.454330 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ddbe9b5a-283f-43e1-9309-dd6f36bb7cfb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:26.454766 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ddbe9b5a-283f-43e1-9309-dd6f36bb7cfb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:26.455436 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ddbe9b5a-283f-43e1-9309-dd6f36bb7cfb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:26.455869 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ddbe9b5a-283f-43e1-9309-dd6f36bb7cfb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:26.456277 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ddbe9b5a-283f-43e1-9309-dd6f36bb7cfb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:26.621854 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ddbe9b5a-283f-43e1-9309-dd6f36bb7cfb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:26.630944 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ddbe9b5a-283f-43e1-9309-dd6f36bb7cfb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1363 microversion: 2.1 time: 0.187955 Aug 26 18:24:26.632249 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 66/146] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:26 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:26.642428 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9b47c052-8aea-4571-853b-8c2cabbc5f0f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:26.644107 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9b47c052-8aea-4571-853b-8c2cabbc5f0f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:26.654491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9b47c052-8aea-4571-853b-8c2cabbc5f0f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:26.655214 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9b47c052-8aea-4571-853b-8c2cabbc5f0f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:26.655880 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9b47c052-8aea-4571-853b-8c2cabbc5f0f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:26.656863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9b47c052-8aea-4571-853b-8c2cabbc5f0f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:26.657420 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9b47c052-8aea-4571-853b-8c2cabbc5f0f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:26.657965 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9b47c052-8aea-4571-853b-8c2cabbc5f0f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:26.788477 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9b47c052-8aea-4571-853b-8c2cabbc5f0f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:26.798185 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9b47c052-8aea-4571-853b-8c2cabbc5f0f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.164701 Aug 26 18:24:26.799135 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 67/147] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:26 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:27.410059 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7c2aa004-b048-4a0b-a66b-eab18eb57d13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:27.410865 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-7c2aa004-b048-4a0b-a66b-eab18eb57d13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:27.418036 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7c2aa004-b048-4a0b-a66b-eab18eb57d13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:27.418515 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7c2aa004-b048-4a0b-a66b-eab18eb57d13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:27.418956 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7c2aa004-b048-4a0b-a66b-eab18eb57d13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:27.419641 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7c2aa004-b048-4a0b-a66b-eab18eb57d13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:27.420085 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7c2aa004-b048-4a0b-a66b-eab18eb57d13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:27.420503 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7c2aa004-b048-4a0b-a66b-eab18eb57d13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:27.561644 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-7c2aa004-b048-4a0b-a66b-eab18eb57d13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:27.569869 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-7c2aa004-b048-4a0b-a66b-eab18eb57d13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:27.571522 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-7c2aa004-b048-4a0b-a66b-eab18eb57d13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:27.572567 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-7c2aa004-b048-4a0b-a66b-eab18eb57d13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.166356 Aug 26 18:24:27.573110 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 68/148] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:27 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:27.653650 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e8911d82-f9da-471f-9ce6-50183cd20057 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:27.654259 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e8911d82-f9da-471f-9ce6-50183cd20057 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:27.660622 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e8911d82-f9da-471f-9ce6-50183cd20057 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:27.661140 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e8911d82-f9da-471f-9ce6-50183cd20057 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:27.661570 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e8911d82-f9da-471f-9ce6-50183cd20057 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:27.662480 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e8911d82-f9da-471f-9ce6-50183cd20057 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:27.662925 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e8911d82-f9da-471f-9ce6-50183cd20057 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:27.663504 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e8911d82-f9da-471f-9ce6-50183cd20057 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:27.812783 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e8911d82-f9da-471f-9ce6-50183cd20057 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:27.821203 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e8911d82-f9da-471f-9ce6-50183cd20057 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1363 microversion: 2.1 time: 0.171268 Aug 26 18:24:27.832822 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 69/149] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:27 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:24:27.832822 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-afe6baae-aac0-4232-9a35-79d6f2b3e463 req-0c61b8e4-2abe-4992-87bc-571332afa3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "024e8a0f-0670-4aec-8ec6-e8afbc67d464", "name": "network-vif-plugged", "status": "completed", "tag": "a2a7330d-44fd-4799-ab35-6c1aa82dab95"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:27.835603 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-afe6baae-aac0-4232-9a35-79d6f2b3e463 req-0c61b8e4-2abe-4992-87bc-571332afa3b7 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:27.836026 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-afe6baae-aac0-4232-9a35-79d6f2b3e463 req-0c61b8e4-2abe-4992-87bc-571332afa3b7 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:27.836707 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-afe6baae-aac0-4232-9a35-79d6f2b3e463 req-0c61b8e4-2abe-4992-87bc-571332afa3b7 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:27.847704 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-afe6baae-aac0-4232-9a35-79d6f2b3e463 req-0c61b8e4-2abe-4992-87bc-571332afa3b7 service nova] Creating event network-vif-plugged:a2a7330d-44fd-4799-ab35-6c1aa82dab95 for instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 on hv-cinder-85199 Aug 26 18:24:27.857150 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-afe6baae-aac0-4232-9a35-79d6f2b3e463 req-0c61b8e4-2abe-4992-87bc-571332afa3b7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029725 Aug 26 18:24:27.857150 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 70/150] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:24:27.858299 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f21a08c4-fbd8-43e0-b292-4687e5baff39 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:27.858991 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f21a08c4-fbd8-43e0-b292-4687e5baff39 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:27.865485 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f21a08c4-fbd8-43e0-b292-4687e5baff39 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:27.866032 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f21a08c4-fbd8-43e0-b292-4687e5baff39 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:27.866911 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f21a08c4-fbd8-43e0-b292-4687e5baff39 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:27.867103 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f21a08c4-fbd8-43e0-b292-4687e5baff39 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:27.867550 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f21a08c4-fbd8-43e0-b292-4687e5baff39 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:27.867968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f21a08c4-fbd8-43e0-b292-4687e5baff39 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:28.019020 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f21a08c4-fbd8-43e0-b292-4687e5baff39 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:28.026784 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f21a08c4-fbd8-43e0-b292-4687e5baff39 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.172265 Aug 26 18:24:28.027739 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 71/151] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:27 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:28.595247 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d800ff7c-c64c-4f6b-bef1-f564c44298d5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:28.595859 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-d800ff7c-c64c-4f6b-bef1-f564c44298d5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:28.601838 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d800ff7c-c64c-4f6b-bef1-f564c44298d5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:28.602318 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d800ff7c-c64c-4f6b-bef1-f564c44298d5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:28.602743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d800ff7c-c64c-4f6b-bef1-f564c44298d5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:28.603428 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d800ff7c-c64c-4f6b-bef1-f564c44298d5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:28.603916 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d800ff7c-c64c-4f6b-bef1-f564c44298d5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:28.604354 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d800ff7c-c64c-4f6b-bef1-f564c44298d5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:28.761772 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d800ff7c-c64c-4f6b-bef1-f564c44298d5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:28.773972 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d800ff7c-c64c-4f6b-bef1-f564c44298d5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:28.776501 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d800ff7c-c64c-4f6b-bef1-f564c44298d5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:28.778065 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-d800ff7c-c64c-4f6b-bef1-f564c44298d5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.186638 Aug 26 18:24:28.778723 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 72/152] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:28 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:24:28.842336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1ba6244e-a43f-408b-adab-4ce756b589ee tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:28.842930 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1ba6244e-a43f-408b-adab-4ce756b589ee tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:28.849177 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1ba6244e-a43f-408b-adab-4ce756b589ee tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:28.849644 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1ba6244e-a43f-408b-adab-4ce756b589ee tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:28.850246 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1ba6244e-a43f-408b-adab-4ce756b589ee tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:28.850923 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1ba6244e-a43f-408b-adab-4ce756b589ee tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:28.851395 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1ba6244e-a43f-408b-adab-4ce756b589ee tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:28.851801 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1ba6244e-a43f-408b-adab-4ce756b589ee tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:29.002552 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1ba6244e-a43f-408b-adab-4ce756b589ee tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:29.011679 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1ba6244e-a43f-408b-adab-4ce756b589ee tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1363 microversion: 2.1 time: 0.172964 Aug 26 18:24:29.012255 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 73/153] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:28 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:29.050461 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-57233cd0-514a-48a0-ada7-cbcc74eef4fe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:29.052747 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-57233cd0-514a-48a0-ada7-cbcc74eef4fe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:29.066542 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-57233cd0-514a-48a0-ada7-cbcc74eef4fe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:29.067036 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-57233cd0-514a-48a0-ada7-cbcc74eef4fe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:29.067792 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-57233cd0-514a-48a0-ada7-cbcc74eef4fe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:29.071704 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-57233cd0-514a-48a0-ada7-cbcc74eef4fe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:29.085692 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-57233cd0-514a-48a0-ada7-cbcc74eef4fe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:29.092239 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-57233cd0-514a-48a0-ada7-cbcc74eef4fe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:29.296635 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0c16419d-6887-48d4-8c9a-61ed48575773 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "POST /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.906453 Aug 26 18:24:29.298242 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 81/154] 10.222.0.45 () {60 vars in 1323 bytes} [Fri Aug 26 18:24:26 2022] POST /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe/os-volume_attachments => generated 194 bytes in 2909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:24:29.541692 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-57233cd0-514a-48a0-ada7-cbcc74eef4fe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:29.550168 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-57233cd0-514a-48a0-ada7-cbcc74eef4fe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.505611 Aug 26 18:24:29.564329 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 74/155] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:29 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:29.802963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d320d810-314f-4266-bac1-cdbfb5735433 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:29.803661 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d320d810-314f-4266-bac1-cdbfb5735433 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:29.810112 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d320d810-314f-4266-bac1-cdbfb5735433 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:29.810634 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d320d810-314f-4266-bac1-cdbfb5735433 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:29.811141 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d320d810-314f-4266-bac1-cdbfb5735433 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:29.812007 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d320d810-314f-4266-bac1-cdbfb5735433 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:29.812603 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d320d810-314f-4266-bac1-cdbfb5735433 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:29.813103 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d320d810-314f-4266-bac1-cdbfb5735433 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:29.877521 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-a9224e28-0d76-4e39-8c3c-1523e4ddaa94 req-c846b105-8586-4de4-b883-37395c6563b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed32b7d-a792-49b2-84e7-962f4d537501", "name": "network-vif-plugged", "status": "completed", "tag": "ae3cb7b6-5071-4281-b758-acbb49eab67f"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:29.891836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-a9224e28-0d76-4e39-8c3c-1523e4ddaa94 req-c846b105-8586-4de4-b883-37395c6563b5 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:29.892585 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-a9224e28-0d76-4e39-8c3c-1523e4ddaa94 req-c846b105-8586-4de4-b883-37395c6563b5 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:29.893130 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-a9224e28-0d76-4e39-8c3c-1523e4ddaa94 req-c846b105-8586-4de4-b883-37395c6563b5 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:29.905137 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-a9224e28-0d76-4e39-8c3c-1523e4ddaa94 req-c846b105-8586-4de4-b883-37395c6563b5 service nova] Creating event network-vif-plugged:ae3cb7b6-5071-4281-b758-acbb49eab67f for instance 1ed32b7d-a792-49b2-84e7-962f4d537501 on hv-cinder-85199 Aug 26 18:24:29.910726 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-a9224e28-0d76-4e39-8c3c-1523e4ddaa94 req-c846b105-8586-4de4-b883-37395c6563b5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040344 Aug 26 18:24:29.912670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 75/156] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:24:30.008768 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d320d810-314f-4266-bac1-cdbfb5735433 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:30.018268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d320d810-314f-4266-bac1-cdbfb5735433 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:30.024866 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d320d810-314f-4266-bac1-cdbfb5735433 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:30.024866 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d320d810-314f-4266-bac1-cdbfb5735433 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.224164 Aug 26 18:24:30.024866 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 82/157] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:29 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:30.042950 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-477fe47f-04b4-4814-9f60-1b440e88eee8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:30.044274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-477fe47f-04b4-4814-9f60-1b440e88eee8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:30.051538 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-477fe47f-04b4-4814-9f60-1b440e88eee8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:30.052532 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-477fe47f-04b4-4814-9f60-1b440e88eee8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:30.052987 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-477fe47f-04b4-4814-9f60-1b440e88eee8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:30.053696 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-477fe47f-04b4-4814-9f60-1b440e88eee8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:30.054495 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-477fe47f-04b4-4814-9f60-1b440e88eee8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:30.054931 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-477fe47f-04b4-4814-9f60-1b440e88eee8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:30.244769 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-477fe47f-04b4-4814-9f60-1b440e88eee8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:30.254952 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-477fe47f-04b4-4814-9f60-1b440e88eee8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1363 microversion: 2.1 time: 0.223294 Aug 26 18:24:30.255954 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 76/158] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:30 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:30.571254 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d988bd0e-f04f-4747-86d6-af73881289fa tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:30.571983 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d988bd0e-f04f-4747-86d6-af73881289fa tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:30.579962 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d988bd0e-f04f-4747-86d6-af73881289fa tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:30.580453 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d988bd0e-f04f-4747-86d6-af73881289fa tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:30.580931 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d988bd0e-f04f-4747-86d6-af73881289fa tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:30.581612 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d988bd0e-f04f-4747-86d6-af73881289fa tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:30.582091 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d988bd0e-f04f-4747-86d6-af73881289fa tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:30.582514 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d988bd0e-f04f-4747-86d6-af73881289fa tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:30.751846 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d988bd0e-f04f-4747-86d6-af73881289fa tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:30.759270 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d988bd0e-f04f-4747-86d6-af73881289fa tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.192058 Aug 26 18:24:30.759833 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 83/159] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:30 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:31.045046 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-186b0d79-61d4-412a-bbb7-af760f82fb94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:31.046375 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-186b0d79-61d4-412a-bbb7-af760f82fb94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:31.053982 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-186b0d79-61d4-412a-bbb7-af760f82fb94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:31.054964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-186b0d79-61d4-412a-bbb7-af760f82fb94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:31.055804 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-186b0d79-61d4-412a-bbb7-af760f82fb94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:31.056790 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-186b0d79-61d4-412a-bbb7-af760f82fb94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:31.057429 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-186b0d79-61d4-412a-bbb7-af760f82fb94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:31.058016 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-186b0d79-61d4-412a-bbb7-af760f82fb94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:31.229757 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-186b0d79-61d4-412a-bbb7-af760f82fb94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:31.239006 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-186b0d79-61d4-412a-bbb7-af760f82fb94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:31.241701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-186b0d79-61d4-412a-bbb7-af760f82fb94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:31.243225 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-186b0d79-61d4-412a-bbb7-af760f82fb94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.202552 Aug 26 18:24:31.244260 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 77/160] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:31 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:31.283843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c75ca649-d41e-4143-a73f-2081555bb75d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:31.283843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c75ca649-d41e-4143-a73f-2081555bb75d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:31.283843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c75ca649-d41e-4143-a73f-2081555bb75d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:31.283843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c75ca649-d41e-4143-a73f-2081555bb75d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:31.284172 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c75ca649-d41e-4143-a73f-2081555bb75d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:31.284172 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c75ca649-d41e-4143-a73f-2081555bb75d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:31.284542 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c75ca649-d41e-4143-a73f-2081555bb75d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:31.285158 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c75ca649-d41e-4143-a73f-2081555bb75d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:31.431591 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c75ca649-d41e-4143-a73f-2081555bb75d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:31.439750 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c75ca649-d41e-4143-a73f-2081555bb75d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1550 microversion: 2.1 time: 0.167846 Aug 26 18:24:31.440922 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 84/161] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:31 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:31.461521 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-93e1a01e-f574-499a-afde-086d88295c14 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:31.462354 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-93e1a01e-f574-499a-afde-086d88295c14 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:31.472279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e1a01e-f574-499a-afde-086d88295c14 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:31.473328 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e1a01e-f574-499a-afde-086d88295c14 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:31.473999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e1a01e-f574-499a-afde-086d88295c14 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:31.475471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e1a01e-f574-499a-afde-086d88295c14 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:31.476547 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e1a01e-f574-499a-afde-086d88295c14 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:31.477225 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e1a01e-f574-499a-afde-086d88295c14 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:31.581102 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-93e1a01e-f574-499a-afde-086d88295c14 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123839 Aug 26 18:24:31.581814 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 78/162] 10.222.0.45 () {58 vars in 1275 bytes} [Fri Aug 26 18:24:31 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:24:31.780425 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-867b3a0b-d44c-4b96-86aa-6b8a843efc1e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:31.781156 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-867b3a0b-d44c-4b96-86aa-6b8a843efc1e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:31.798439 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867b3a0b-d44c-4b96-86aa-6b8a843efc1e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:31.801282 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867b3a0b-d44c-4b96-86aa-6b8a843efc1e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:31.802456 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867b3a0b-d44c-4b96-86aa-6b8a843efc1e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:31.803242 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867b3a0b-d44c-4b96-86aa-6b8a843efc1e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:31.803785 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867b3a0b-d44c-4b96-86aa-6b8a843efc1e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:31.804297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867b3a0b-d44c-4b96-86aa-6b8a843efc1e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:32.266000 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-79c0cdbf-2015-4aea-a738-d9d55ad6774d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:32.266618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-79c0cdbf-2015-4aea-a738-d9d55ad6774d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:32.273283 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79c0cdbf-2015-4aea-a738-d9d55ad6774d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:32.273780 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79c0cdbf-2015-4aea-a738-d9d55ad6774d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:32.274337 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79c0cdbf-2015-4aea-a738-d9d55ad6774d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:32.275269 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79c0cdbf-2015-4aea-a738-d9d55ad6774d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:32.276444 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79c0cdbf-2015-4aea-a738-d9d55ad6774d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:32.276920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79c0cdbf-2015-4aea-a738-d9d55ad6774d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:32.309775 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-867b3a0b-d44c-4b96-86aa-6b8a843efc1e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:32.323457 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-867b3a0b-d44c-4b96-86aa-6b8a843efc1e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.547391 Aug 26 18:24:32.324332 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 85/163] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:31 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:32.460551 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-79c0cdbf-2015-4aea-a738-d9d55ad6774d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:32.474919 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-79c0cdbf-2015-4aea-a738-d9d55ad6774d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:32.477762 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-79c0cdbf-2015-4aea-a738-d9d55ad6774d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:32.479523 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-79c0cdbf-2015-4aea-a738-d9d55ad6774d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1408 microversion: 2.20 time: 0.218064 Aug 26 18:24:32.489548 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 79/164] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:32 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:33.284680 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-04910630-9709-486a-9840-f34f19631440 req-3ac2e5a5-ab66-4b12-86d3-05a3670b4560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "024e8a0f-0670-4aec-8ec6-e8afbc67d464", "tag": "a2a7330d-44fd-4799-ab35-6c1aa82dab95"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:33.297548 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-04910630-9709-486a-9840-f34f19631440 req-3ac2e5a5-ab66-4b12-86d3-05a3670b4560 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:33.298401 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-04910630-9709-486a-9840-f34f19631440 req-3ac2e5a5-ab66-4b12-86d3-05a3670b4560 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:33.298882 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-04910630-9709-486a-9840-f34f19631440 req-3ac2e5a5-ab66-4b12-86d3-05a3670b4560 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:33.313778 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-04910630-9709-486a-9840-f34f19631440 req-3ac2e5a5-ab66-4b12-86d3-05a3670b4560 service nova] Creating event network-changed:a2a7330d-44fd-4799-ab35-6c1aa82dab95 for instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 on hv-cinder-85199 Aug 26 18:24:33.319729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-04910630-9709-486a-9840-f34f19631440 req-3ac2e5a5-ab66-4b12-86d3-05a3670b4560 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039067 Aug 26 18:24:33.321125 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 86/165] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:24:33.346702 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-90089920-a6d2-4aff-8e8e-866eea5ad560 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:33.347323 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-90089920-a6d2-4aff-8e8e-866eea5ad560 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:33.353891 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-90089920-a6d2-4aff-8e8e-866eea5ad560 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:33.354684 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-90089920-a6d2-4aff-8e8e-866eea5ad560 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:33.355295 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-90089920-a6d2-4aff-8e8e-866eea5ad560 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:33.356274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-90089920-a6d2-4aff-8e8e-866eea5ad560 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:33.357163 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-90089920-a6d2-4aff-8e8e-866eea5ad560 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:33.357947 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-90089920-a6d2-4aff-8e8e-866eea5ad560 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:33.512109 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-06cd6834-af33-4d6c-a8d4-32082dd8f7e5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:33.513135 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-06cd6834-af33-4d6c-a8d4-32082dd8f7e5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:33.514256 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-90089920-a6d2-4aff-8e8e-866eea5ad560 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:33.525979 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-90089920-a6d2-4aff-8e8e-866eea5ad560 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.182671 Aug 26 18:24:33.527320 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 80/166] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:33 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:33.538430 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06cd6834-af33-4d6c-a8d4-32082dd8f7e5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:33.538934 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06cd6834-af33-4d6c-a8d4-32082dd8f7e5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:33.539371 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06cd6834-af33-4d6c-a8d4-32082dd8f7e5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:33.543356 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06cd6834-af33-4d6c-a8d4-32082dd8f7e5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:33.543941 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06cd6834-af33-4d6c-a8d4-32082dd8f7e5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:33.544505 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06cd6834-af33-4d6c-a8d4-32082dd8f7e5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:33.745881 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-06cd6834-af33-4d6c-a8d4-32082dd8f7e5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:33.758098 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-06cd6834-af33-4d6c-a8d4-32082dd8f7e5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:33.760428 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-06cd6834-af33-4d6c-a8d4-32082dd8f7e5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:33.762021 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-06cd6834-af33-4d6c-a8d4-32082dd8f7e5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1599 microversion: 2.20 time: 0.261906 Aug 26 18:24:33.762901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 87/167] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:24:33 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1599 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:24:33.788323 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-eb350dda-7405-418b-ac4e-c1d6dc7856b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:33.789138 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-eb350dda-7405-418b-ac4e-c1d6dc7856b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:33.798407 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb350dda-7405-418b-ac4e-c1d6dc7856b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:33.799280 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb350dda-7405-418b-ac4e-c1d6dc7856b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:33.799927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb350dda-7405-418b-ac4e-c1d6dc7856b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:33.801121 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb350dda-7405-418b-ac4e-c1d6dc7856b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:33.801810 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb350dda-7405-418b-ac4e-c1d6dc7856b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:33.803296 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb350dda-7405-418b-ac4e-c1d6dc7856b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:33.899934 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-eb350dda-7405-418b-ac4e-c1d6dc7856b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.116098 Aug 26 18:24:33.901077 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 81/168] 10.222.0.45 () {60 vars in 1316 bytes} [Fri Aug 26 18:24:33 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:24:34.553137 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-109ab6c6-ae54-49f7-bcee-5c07263e73cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:34.554624 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-109ab6c6-ae54-49f7-bcee-5c07263e73cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:34.564246 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-109ab6c6-ae54-49f7-bcee-5c07263e73cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:34.565359 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-109ab6c6-ae54-49f7-bcee-5c07263e73cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:34.566261 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-109ab6c6-ae54-49f7-bcee-5c07263e73cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:34.566989 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-109ab6c6-ae54-49f7-bcee-5c07263e73cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:34.567441 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-109ab6c6-ae54-49f7-bcee-5c07263e73cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:34.568047 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-109ab6c6-ae54-49f7-bcee-5c07263e73cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:34.807267 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-109ab6c6-ae54-49f7-bcee-5c07263e73cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:34.830797 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-109ab6c6-ae54-49f7-bcee-5c07263e73cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.283540 Aug 26 18:24:34.832964 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 88/169] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:34 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:35.717190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-ecebeca4-b901-402f-8021-8205632fb5a4 req-5c4838bb-6217-40a9-b542-de2658887637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed32b7d-a792-49b2-84e7-962f4d537501", "tag": "ae3cb7b6-5071-4281-b758-acbb49eab67f"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:35.727752 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ecebeca4-b901-402f-8021-8205632fb5a4 req-5c4838bb-6217-40a9-b542-de2658887637 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:35.728361 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ecebeca4-b901-402f-8021-8205632fb5a4 req-5c4838bb-6217-40a9-b542-de2658887637 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:35.728812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ecebeca4-b901-402f-8021-8205632fb5a4 req-5c4838bb-6217-40a9-b542-de2658887637 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:35.741720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-ecebeca4-b901-402f-8021-8205632fb5a4 req-5c4838bb-6217-40a9-b542-de2658887637 service nova] Creating event network-changed:ae3cb7b6-5071-4281-b758-acbb49eab67f for instance 1ed32b7d-a792-49b2-84e7-962f4d537501 on hv-cinder-85199 Aug 26 18:24:35.747919 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-ecebeca4-b901-402f-8021-8205632fb5a4 req-5c4838bb-6217-40a9-b542-de2658887637 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035358 Aug 26 18:24:35.748807 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 82/170] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:24:35.854766 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2035b812-896c-475f-b929-5417809684f7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:35.855649 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2035b812-896c-475f-b929-5417809684f7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:35.862311 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=92 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:35.865037 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2035b812-896c-475f-b929-5417809684f7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:35.865847 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2035b812-896c-475f-b929-5417809684f7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:35.866632 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2035b812-896c-475f-b929-5417809684f7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:35.867749 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2035b812-896c-475f-b929-5417809684f7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:35.868414 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2035b812-896c-475f-b929-5417809684f7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:35.869364 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2035b812-896c-475f-b929-5417809684f7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:36.064109 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2035b812-896c-475f-b929-5417809684f7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:36.076241 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2035b812-896c-475f-b929-5417809684f7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.225578 Aug 26 18:24:36.088805 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 89/171] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:35 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:37.096974 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ef72bc2a-1469-425c-abf7-ab4b26ec00f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:37.102284 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ef72bc2a-1469-425c-abf7-ab4b26ec00f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:37.120991 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ef72bc2a-1469-425c-abf7-ab4b26ec00f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:37.125169 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ef72bc2a-1469-425c-abf7-ab4b26ec00f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:37.126710 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ef72bc2a-1469-425c-abf7-ab4b26ec00f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:37.128884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ef72bc2a-1469-425c-abf7-ab4b26ec00f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:37.129431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ef72bc2a-1469-425c-abf7-ab4b26ec00f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:37.130243 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ef72bc2a-1469-425c-abf7-ab4b26ec00f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:37.404181 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ef72bc2a-1469-425c-abf7-ab4b26ec00f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:37.432554 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ef72bc2a-1469-425c-abf7-ab4b26ec00f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.339548 Aug 26 18:24:37.433493 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 83/172] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:37 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:38.455054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8e531dbc-8b52-488c-a166-a84b61d1be89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:38.455667 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8e531dbc-8b52-488c-a166-a84b61d1be89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:38.466789 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e531dbc-8b52-488c-a166-a84b61d1be89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:38.466789 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e531dbc-8b52-488c-a166-a84b61d1be89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:38.466789 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e531dbc-8b52-488c-a166-a84b61d1be89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:38.466789 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e531dbc-8b52-488c-a166-a84b61d1be89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:38.467319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e531dbc-8b52-488c-a166-a84b61d1be89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:38.467396 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e531dbc-8b52-488c-a166-a84b61d1be89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:38.641199 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8e531dbc-8b52-488c-a166-a84b61d1be89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:38.649397 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8e531dbc-8b52-488c-a166-a84b61d1be89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.199006 Aug 26 18:24:38.649961 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 90/173] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:38 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:39.671147 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-88709fb0-13b7-4ab0-9249-9f9418e60a8c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:39.671933 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-88709fb0-13b7-4ab0-9249-9f9418e60a8c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:39.678220 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-88709fb0-13b7-4ab0-9249-9f9418e60a8c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:39.678698 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-88709fb0-13b7-4ab0-9249-9f9418e60a8c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:39.679118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-88709fb0-13b7-4ab0-9249-9f9418e60a8c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:39.679897 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-88709fb0-13b7-4ab0-9249-9f9418e60a8c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:39.680259 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-88709fb0-13b7-4ab0-9249-9f9418e60a8c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:39.680636 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-88709fb0-13b7-4ab0-9249-9f9418e60a8c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:39.868008 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-88709fb0-13b7-4ab0-9249-9f9418e60a8c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:39.872424 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:39.878449 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-88709fb0-13b7-4ab0-9249-9f9418e60a8c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.211904 Aug 26 18:24:39.901033 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 84/174] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:39 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:40.905694 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e80a90d9-9233-4f38-9097-e1f73a9ac41b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:40.907469 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e80a90d9-9233-4f38-9097-e1f73a9ac41b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:40.916656 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e80a90d9-9233-4f38-9097-e1f73a9ac41b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:40.918797 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e80a90d9-9233-4f38-9097-e1f73a9ac41b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:40.919742 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e80a90d9-9233-4f38-9097-e1f73a9ac41b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:40.921837 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e80a90d9-9233-4f38-9097-e1f73a9ac41b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:40.922806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e80a90d9-9233-4f38-9097-e1f73a9ac41b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:40.923505 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e80a90d9-9233-4f38-9097-e1f73a9ac41b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:40.954599 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-bc2814bc-2169-4e59-b095-6d6a3afa2b67 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:40.955960 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-bc2814bc-2169-4e59-b095-6d6a3afa2b67 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:40.964299 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bc2814bc-2169-4e59-b095-6d6a3afa2b67 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:40.964741 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bc2814bc-2169-4e59-b095-6d6a3afa2b67 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:40.965229 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bc2814bc-2169-4e59-b095-6d6a3afa2b67 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:40.965931 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bc2814bc-2169-4e59-b095-6d6a3afa2b67 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:40.966377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bc2814bc-2169-4e59-b095-6d6a3afa2b67 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:40.966796 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bc2814bc-2169-4e59-b095-6d6a3afa2b67 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:41.007919 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-bc2814bc-2169-4e59-b095-6d6a3afa2b67 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Going to try to terminate instance {{(pid=120540) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:24:41.077612 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e80a90d9-9233-4f38-9097-e1f73a9ac41b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:41.085643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e80a90d9-9233-4f38-9097-e1f73a9ac41b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.185206 Aug 26 18:24:41.086220 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 91/175] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:40 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:41.095560 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-bc2814bc-2169-4e59-b095-6d6a3afa2b67 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 204 len: 0 microversion: 2.1 time: 0.145875 Aug 26 18:24:41.096136 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 85/176] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:24:40 2022] DELETE /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 18:24:41.104298 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5a4ac900-7ca2-4b54-a288-19dcbe060990 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:41.104905 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5a4ac900-7ca2-4b54-a288-19dcbe060990 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:41.111016 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a4ac900-7ca2-4b54-a288-19dcbe060990 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:41.111550 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a4ac900-7ca2-4b54-a288-19dcbe060990 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:41.112028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a4ac900-7ca2-4b54-a288-19dcbe060990 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:41.112748 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a4ac900-7ca2-4b54-a288-19dcbe060990 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:41.113294 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a4ac900-7ca2-4b54-a288-19dcbe060990 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:41.113726 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a4ac900-7ca2-4b54-a288-19dcbe060990 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:41.242467 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5a4ac900-7ca2-4b54-a288-19dcbe060990 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:41.252122 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5a4ac900-7ca2-4b54-a288-19dcbe060990 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1552 microversion: 2.1 time: 0.151602 Aug 26 18:24:41.252757 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 92/177] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:41 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:42.107851 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9860f0aa-3363-44ed-9d0e-807564b599ac tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:42.108994 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9860f0aa-3363-44ed-9d0e-807564b599ac tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:42.116855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9860f0aa-3363-44ed-9d0e-807564b599ac tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:42.117521 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9860f0aa-3363-44ed-9d0e-807564b599ac tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:42.117957 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9860f0aa-3363-44ed-9d0e-807564b599ac tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:42.118797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9860f0aa-3363-44ed-9d0e-807564b599ac tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:42.119383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9860f0aa-3363-44ed-9d0e-807564b599ac tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:42.119881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9860f0aa-3363-44ed-9d0e-807564b599ac tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:42.264695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9860f0aa-3363-44ed-9d0e-807564b599ac tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:42.273644 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9860f0aa-3363-44ed-9d0e-807564b599ac tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.170130 Aug 26 18:24:42.276749 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 86/178] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:42 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:42.276923 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9eb55bd7-637d-4d8c-a01a-be351fc5f5c2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:42.276923 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9eb55bd7-637d-4d8c-a01a-be351fc5f5c2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:42.283407 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9eb55bd7-637d-4d8c-a01a-be351fc5f5c2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:42.283846 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9eb55bd7-637d-4d8c-a01a-be351fc5f5c2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:42.284268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9eb55bd7-637d-4d8c-a01a-be351fc5f5c2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:42.285054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9eb55bd7-637d-4d8c-a01a-be351fc5f5c2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:42.285507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9eb55bd7-637d-4d8c-a01a-be351fc5f5c2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:42.285924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9eb55bd7-637d-4d8c-a01a-be351fc5f5c2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:42.424417 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9eb55bd7-637d-4d8c-a01a-be351fc5f5c2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:42.433337 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9eb55bd7-637d-4d8c-a01a-be351fc5f5c2 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1552 microversion: 2.1 time: 0.163409 Aug 26 18:24:42.434213 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 93/179] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:42 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:43.295624 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e34d8b0b-01d1-4186-9d77-99575dbacd7b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:43.296228 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e34d8b0b-01d1-4186-9d77-99575dbacd7b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:43.308035 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e34d8b0b-01d1-4186-9d77-99575dbacd7b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:43.309428 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e34d8b0b-01d1-4186-9d77-99575dbacd7b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:43.313356 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e34d8b0b-01d1-4186-9d77-99575dbacd7b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:43.315330 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e34d8b0b-01d1-4186-9d77-99575dbacd7b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:43.316010 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e34d8b0b-01d1-4186-9d77-99575dbacd7b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:43.316628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e34d8b0b-01d1-4186-9d77-99575dbacd7b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:43.456322 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f08067df-de37-4514-8886-51a4d68d0fb6 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:43.457104 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f08067df-de37-4514-8886-51a4d68d0fb6 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:43.468665 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f08067df-de37-4514-8886-51a4d68d0fb6 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:43.470348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f08067df-de37-4514-8886-51a4d68d0fb6 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:43.472162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f08067df-de37-4514-8886-51a4d68d0fb6 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:43.473993 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f08067df-de37-4514-8886-51a4d68d0fb6 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:43.475637 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f08067df-de37-4514-8886-51a4d68d0fb6 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:43.478062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f08067df-de37-4514-8886-51a4d68d0fb6 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:43.571579 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e34d8b0b-01d1-4186-9d77-99575dbacd7b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:43.593739 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e34d8b0b-01d1-4186-9d77-99575dbacd7b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.297868 Aug 26 18:24:43.599203 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 87/180] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:43 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:43.908800 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f08067df-de37-4514-8886-51a4d68d0fb6 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:43.934865 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f08067df-de37-4514-8886-51a4d68d0fb6 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1552 microversion: 2.1 time: 0.469736 Aug 26 18:24:43.944745 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 94/181] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:43 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1552 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:24:44.375104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-be17dd37-06f3-4cf8-bac5-12d040d85543 req-0183c670-9d50-49d5-b996-51d654e63603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88ac3fc-3407-4752-8978-4284558e0cfe", "name": "network-vif-deleted", "tag": "62f67bf0-ea26-4bf6-a2f2-413adc6e16e0"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:44.387607 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-be17dd37-06f3-4cf8-bac5-12d040d85543 req-0183c670-9d50-49d5-b996-51d654e63603 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:44.388422 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-be17dd37-06f3-4cf8-bac5-12d040d85543 req-0183c670-9d50-49d5-b996-51d654e63603 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:44.389383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-be17dd37-06f3-4cf8-bac5-12d040d85543 req-0183c670-9d50-49d5-b996-51d654e63603 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:44.409607 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-be17dd37-06f3-4cf8-bac5-12d040d85543 req-0183c670-9d50-49d5-b996-51d654e63603 service nova] Creating event network-vif-deleted:62f67bf0-ea26-4bf6-a2f2-413adc6e16e0 for instance c88ac3fc-3407-4752-8978-4284558e0cfe on hv-cinder-85199 Aug 26 18:24:44.419673 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-be17dd37-06f3-4cf8-bac5-12d040d85543 req-0183c670-9d50-49d5-b996-51d654e63603 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048744 Aug 26 18:24:44.426482 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 88/182] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:24:44.619580 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-10489b50-e433-412a-9512-5f1b5e315e12 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:44.620700 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-10489b50-e433-412a-9512-5f1b5e315e12 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:44.628015 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10489b50-e433-412a-9512-5f1b5e315e12 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:44.628518 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10489b50-e433-412a-9512-5f1b5e315e12 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:44.629006 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10489b50-e433-412a-9512-5f1b5e315e12 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:44.629705 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10489b50-e433-412a-9512-5f1b5e315e12 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:44.630153 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10489b50-e433-412a-9512-5f1b5e315e12 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:44.630575 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10489b50-e433-412a-9512-5f1b5e315e12 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:44.635391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:44.776013 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-10489b50-e433-412a-9512-5f1b5e315e12 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:44.788482 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-10489b50-e433-412a-9512-5f1b5e315e12 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.172915 Aug 26 18:24:44.790002 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 95/183] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:44 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:44.966573 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-869ed21b-f6ca-430c-b3de-c09de613d92a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:44.967149 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-869ed21b-f6ca-430c-b3de-c09de613d92a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:44.978804 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-869ed21b-f6ca-430c-b3de-c09de613d92a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:44.979329 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-869ed21b-f6ca-430c-b3de-c09de613d92a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:44.979761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-869ed21b-f6ca-430c-b3de-c09de613d92a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:44.980460 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-869ed21b-f6ca-430c-b3de-c09de613d92a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:44.981327 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-869ed21b-f6ca-430c-b3de-c09de613d92a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:44.981744 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-869ed21b-f6ca-430c-b3de-c09de613d92a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:45.022220 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-869ed21b-f6ca-430c-b3de-c09de613d92a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:45.023143 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-869ed21b-f6ca-430c-b3de-c09de613d92a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:45.024183 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-869ed21b-f6ca-430c-b3de-c09de613d92a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:45.025142 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-869ed21b-f6ca-430c-b3de-c09de613d92a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lazy-loading 'fault' on Instance uuid c88ac3fc-3407-4752-8978-4284558e0cfe {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:24:45.095834 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-869ed21b-f6ca-430c-b3de-c09de613d92a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c019d1c81a764d42b98222c8146b8ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c525ea582b264cd5866aa7f403999cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:45.102403 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-869ed21b-f6ca-430c-b3de-c09de613d92a tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 200 len: 1350 microversion: 2.1 time: 0.141437 Aug 26 18:24:45.103368 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 89/184] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:44 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 1350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:45.811600 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-303e1f38-1d19-4f8c-a3df-262d42117c89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:45.812269 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-303e1f38-1d19-4f8c-a3df-262d42117c89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:45.818963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-303e1f38-1d19-4f8c-a3df-262d42117c89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:45.819447 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-303e1f38-1d19-4f8c-a3df-262d42117c89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:45.819876 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-303e1f38-1d19-4f8c-a3df-262d42117c89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:45.820569 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-303e1f38-1d19-4f8c-a3df-262d42117c89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:45.821036 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-303e1f38-1d19-4f8c-a3df-262d42117c89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:45.821465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-303e1f38-1d19-4f8c-a3df-262d42117c89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:45.953138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-303e1f38-1d19-4f8c-a3df-262d42117c89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:45.961558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-303e1f38-1d19-4f8c-a3df-262d42117c89 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.153844 Aug 26 18:24:45.962146 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 96/185] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:45 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:46.129578 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-20668ffd-4e8d-4cc6-addf-747e4ef2d484 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:46.130566 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-20668ffd-4e8d-4cc6-addf-747e4ef2d484 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:46.140261 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20668ffd-4e8d-4cc6-addf-747e4ef2d484 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:46.141047 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20668ffd-4e8d-4cc6-addf-747e4ef2d484 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:46.141739 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20668ffd-4e8d-4cc6-addf-747e4ef2d484 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:46.142872 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20668ffd-4e8d-4cc6-addf-747e4ef2d484 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:46.144357 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20668ffd-4e8d-4cc6-addf-747e4ef2d484 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:46.145314 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20668ffd-4e8d-4cc6-addf-747e4ef2d484 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:46.170043 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-20668ffd-4e8d-4cc6-addf-747e4ef2d484 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] HTTP exception thrown: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-20668ffd-4e8d-4cc6-addf-747e4ef2d484 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Request method failure captured: Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe HTTP/1.1 Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ-m9QjHPMnbCipQxrocu_CXa9hSFMgBj1bfKQdXn2a6KKCa8I8MPT_1KjRbGghYYKFtdMQGRIr2wMbNfaiS8-ARk1viMgYwLzYcWFjdtZrp765fdvggVxSv0Exh1qYpue9dZcOeckqHK4nbpK8zNqBqvKeBVfuu1ak7pVUeYzSDpk0 Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: c525ea582b264cd5866aa7f403999cba Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-DeleteServersTestJSON-138411135 Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:24:46.178431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:24:46.181186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c525ea582b264cd5866aa7f403999cba", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c525ea582b264cd5866aa7f403999cba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c525ea582b264cd5866aa7f403999cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c525ea582b264cd5866aa7f403999cba"}]}] Aug 26 18:24:46.181186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-DeleteServersTestJSON-138411135 Aug 26 18:24:46.181186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: c525ea582b264cd5866aa7f403999cba Aug 26 18:24:46.181186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-DeleteServersTestJSON-138411135 Aug 26 18:24:46.181186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-DeleteServersTestJSON-138411135-project Aug 26 18:24:46.181186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:24:46.181186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:24:46.181186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: c019d1c81a764d42b98222c8146b8ce2 Aug 26 18:24:46.181186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-DeleteServersTestJSON-138411135-project Aug 26 18:24:46.181186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:24:46.181186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:46.181186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': 'c88ac3fc-3407-4752-8978-4284558e0cfe'} Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:24:46.182645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:46.185286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:24:46.188502 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-20668ffd-4e8d-4cc6-addf-747e4ef2d484 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Returning 404 to user: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:24:46.190699 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-20668ffd-4e8d-4cc6-addf-747e4ef2d484 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 404 len: 111 microversion: 2.1 time: 0.069263 Aug 26 18:24:46.191636 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 90/186] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:46 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:24:46.346585 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f410f006-eec8-4d31-9a07-cf624abdd64b tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:46.348849 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f410f006-eec8-4d31-9a07-cf624abdd64b tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:46.354739 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f410f006-eec8-4d31-9a07-cf624abdd64b tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:46.355227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f410f006-eec8-4d31-9a07-cf624abdd64b tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:46.355694 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f410f006-eec8-4d31-9a07-cf624abdd64b tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:46.356555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f410f006-eec8-4d31-9a07-cf624abdd64b tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:46.357183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f410f006-eec8-4d31-9a07-cf624abdd64b tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:46.357781 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f410f006-eec8-4d31-9a07-cf624abdd64b tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:46.372246 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-f410f006-eec8-4d31-9a07-cf624abdd64b tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] HTTP exception thrown: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f410f006-eec8-4d31-9a07-cf624abdd64b tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Request method failure captured: Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe/os-volume_attachments HTTP/1.1 Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ-m9QjHPMnbCipQxrocu_CXa9hSFMgBj1bfKQdXn2a6KKCa8I8MPT_1KjRbGghYYKFtdMQGRIr2wMbNfaiS8-ARk1viMgYwLzYcWFjdtZrp765fdvggVxSv0Exh1qYpue9dZcOeckqHK4nbpK8zNqBqvKeBVfuu1ak7pVUeYzSDpk0 Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: c525ea582b264cd5866aa7f403999cba Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-DeleteServersTestJSON-138411135 Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:24:46.383895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:24:46.385710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c525ea582b264cd5866aa7f403999cba", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c525ea582b264cd5866aa7f403999cba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c525ea582b264cd5866aa7f403999cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c525ea582b264cd5866aa7f403999cba"}]}] Aug 26 18:24:46.385710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-DeleteServersTestJSON-138411135 Aug 26 18:24:46.385710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: c525ea582b264cd5866aa7f403999cba Aug 26 18:24:46.385710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-DeleteServersTestJSON-138411135 Aug 26 18:24:46.385710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-DeleteServersTestJSON-138411135-project Aug 26 18:24:46.385710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:24:46.385710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:24:46.385710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: c019d1c81a764d42b98222c8146b8ce2 Aug 26 18:24:46.385710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-DeleteServersTestJSON-138411135-project Aug 26 18:24:46.385710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:24:46.385710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:46.385710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'server_id': 'c88ac3fc-3407-4752-8978-4284558e0cfe'} Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:24:46.386511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:46.387755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:24:46.388917 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f410f006-eec8-4d31-9a07-cf624abdd64b tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Returning 404 to user: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:24:46.388917 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f410f006-eec8-4d31-9a07-cf624abdd64b tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043599 Aug 26 18:24:46.388917 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 97/187] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:24:46 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:24:46.984858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c6937d2d-2d16-4c20-a8ab-d5c44abadab6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:46.986586 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c6937d2d-2d16-4c20-a8ab-d5c44abadab6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:46.993119 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6937d2d-2d16-4c20-a8ab-d5c44abadab6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:46.993737 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6937d2d-2d16-4c20-a8ab-d5c44abadab6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:46.994279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6937d2d-2d16-4c20-a8ab-d5c44abadab6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:46.995341 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6937d2d-2d16-4c20-a8ab-d5c44abadab6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:46.995931 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6937d2d-2d16-4c20-a8ab-d5c44abadab6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:46.996992 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6937d2d-2d16-4c20-a8ab-d5c44abadab6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:47.198399 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c6937d2d-2d16-4c20-a8ab-d5c44abadab6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:47.207722 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c6937d2d-2d16-4c20-a8ab-d5c44abadab6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.229665 Aug 26 18:24:47.209041 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 91/188] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:46 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:47.630865 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-39ff483e-2044-49d8-aa2e-3c21031fd515 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:47.631386 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-39ff483e-2044-49d8-aa2e-3c21031fd515 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:47.648265 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39ff483e-2044-49d8-aa2e-3c21031fd515 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:47.648265 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39ff483e-2044-49d8-aa2e-3c21031fd515 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:47.648265 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39ff483e-2044-49d8-aa2e-3c21031fd515 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:47.648265 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39ff483e-2044-49d8-aa2e-3c21031fd515 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:47.648631 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39ff483e-2044-49d8-aa2e-3c21031fd515 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:47.648631 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39ff483e-2044-49d8-aa2e-3c21031fd515 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:47.664906 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-39ff483e-2044-49d8-aa2e-3c21031fd515 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] HTTP exception thrown: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-39ff483e-2044-49d8-aa2e-3c21031fd515 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Request method failure captured: Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe HTTP/1.1 Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ-m9QjHPMnbCipQxrocu_CXa9hSFMgBj1bfKQdXn2a6KKCa8I8MPT_1KjRbGghYYKFtdMQGRIr2wMbNfaiS8-ARk1viMgYwLzYcWFjdtZrp765fdvggVxSv0Exh1qYpue9dZcOeckqHK4nbpK8zNqBqvKeBVfuu1ak7pVUeYzSDpk0 Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: c525ea582b264cd5866aa7f403999cba Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-DeleteServersTestJSON-138411135 Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:24:47.672009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:24:47.673319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c525ea582b264cd5866aa7f403999cba", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c525ea582b264cd5866aa7f403999cba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c525ea582b264cd5866aa7f403999cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c525ea582b264cd5866aa7f403999cba"}]}] Aug 26 18:24:47.673319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-DeleteServersTestJSON-138411135 Aug 26 18:24:47.673319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: c525ea582b264cd5866aa7f403999cba Aug 26 18:24:47.673319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-DeleteServersTestJSON-138411135 Aug 26 18:24:47.673319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-DeleteServersTestJSON-138411135-project Aug 26 18:24:47.673319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:24:47.673319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:24:47.673319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: c019d1c81a764d42b98222c8146b8ce2 Aug 26 18:24:47.673319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-DeleteServersTestJSON-138411135-project Aug 26 18:24:47.673319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:24:47.673319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:47.673319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': 'c88ac3fc-3407-4752-8978-4284558e0cfe'} Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:24:47.674005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:47.675149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:24:47.676161 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-39ff483e-2044-49d8-aa2e-3c21031fd515 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Returning 404 to user: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:24:47.676161 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-39ff483e-2044-49d8-aa2e-3c21031fd515 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 404 len: 111 microversion: 2.1 time: 0.047420 Aug 26 18:24:47.676161 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 98/189] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:24:47 2022] DELETE /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:24:47.685101 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d8ff032b-81a9-4f84-adc5-7e5ae12be369 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:47.685814 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-d8ff032b-81a9-4f84-adc5-7e5ae12be369 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] [instance: c88ac3fc-3407-4752-8978-4284558e0cfe] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:47.692758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d8ff032b-81a9-4f84-adc5-7e5ae12be369 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:47.693491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d8ff032b-81a9-4f84-adc5-7e5ae12be369 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:47.694215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d8ff032b-81a9-4f84-adc5-7e5ae12be369 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:47.695117 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d8ff032b-81a9-4f84-adc5-7e5ae12be369 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:47.695767 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d8ff032b-81a9-4f84-adc5-7e5ae12be369 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:47.696861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d8ff032b-81a9-4f84-adc5-7e5ae12be369 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:47.713582 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-d8ff032b-81a9-4f84-adc5-7e5ae12be369 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] HTTP exception thrown: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d8ff032b-81a9-4f84-adc5-7e5ae12be369 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Request method failure captured: Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe HTTP/1.1 Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ-m9QjHPMnbCipQxrocu_CXa9hSFMgBj1bfKQdXn2a6KKCa8I8MPT_1KjRbGghYYKFtdMQGRIr2wMbNfaiS8-ARk1viMgYwLzYcWFjdtZrp765fdvggVxSv0Exh1qYpue9dZcOeckqHK4nbpK8zNqBqvKeBVfuu1ak7pVUeYzSDpk0 Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: c525ea582b264cd5866aa7f403999cba Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-DeleteServersTestJSON-138411135 Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:24:47.715545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:24:47.716695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c525ea582b264cd5866aa7f403999cba", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c525ea582b264cd5866aa7f403999cba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c525ea582b264cd5866aa7f403999cba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c525ea582b264cd5866aa7f403999cba"}]}] Aug 26 18:24:47.716695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-DeleteServersTestJSON-138411135 Aug 26 18:24:47.716695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: c525ea582b264cd5866aa7f403999cba Aug 26 18:24:47.716695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-DeleteServersTestJSON-138411135 Aug 26 18:24:47.716695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-DeleteServersTestJSON-138411135-project Aug 26 18:24:47.716695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:24:47.716695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:24:47.716695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: c019d1c81a764d42b98222c8146b8ce2 Aug 26 18:24:47.716695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-DeleteServersTestJSON-138411135-project Aug 26 18:24:47.716695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:24:47.716695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:47.716695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': 'c88ac3fc-3407-4752-8978-4284558e0cfe'} Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:24:47.717471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. Aug 26 18:24:47.718526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:24:47.720228 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d8ff032b-81a9-4f84-adc5-7e5ae12be369 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] Returning 404 to user: Instance c88ac3fc-3407-4752-8978-4284558e0cfe could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:24:47.721979 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-d8ff032b-81a9-4f84-adc5-7e5ae12be369 tempest-DeleteServersTestJSON-138411135 tempest-DeleteServersTestJSON-138411135-project] 10.222.0.45 "GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe" status: 404 len: 111 microversion: 2.1 time: 0.041071 Aug 26 18:24:47.723206 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 92/190] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:47 2022] GET /compute/v2.1/servers/c88ac3fc-3407-4752-8978-4284558e0cfe => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 18:24:48.230331 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-221b472b-8307-4fef-b0b5-b519b1a0a1ef tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:48.231009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-221b472b-8307-4fef-b0b5-b519b1a0a1ef tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:48.239507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221b472b-8307-4fef-b0b5-b519b1a0a1ef tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:48.240468 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221b472b-8307-4fef-b0b5-b519b1a0a1ef tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:48.240957 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221b472b-8307-4fef-b0b5-b519b1a0a1ef tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:48.241663 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221b472b-8307-4fef-b0b5-b519b1a0a1ef tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:48.242110 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221b472b-8307-4fef-b0b5-b519b1a0a1ef tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:48.243089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221b472b-8307-4fef-b0b5-b519b1a0a1ef tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:48.747742 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-221b472b-8307-4fef-b0b5-b519b1a0a1ef tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:48.756094 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-221b472b-8307-4fef-b0b5-b519b1a0a1ef tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.530202 Aug 26 18:24:48.756890 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 99/191] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:48 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:49.778441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f2a67fb6-d3e1-4858-b4e1-e0c01ad43df7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:49.779516 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f2a67fb6-d3e1-4858-b4e1-e0c01ad43df7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:49.785181 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f2a67fb6-d3e1-4858-b4e1-e0c01ad43df7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:49.785659 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f2a67fb6-d3e1-4858-b4e1-e0c01ad43df7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:49.786281 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f2a67fb6-d3e1-4858-b4e1-e0c01ad43df7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:49.786983 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f2a67fb6-d3e1-4858-b4e1-e0c01ad43df7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:49.787430 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f2a67fb6-d3e1-4858-b4e1-e0c01ad43df7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:49.787851 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f2a67fb6-d3e1-4858-b4e1-e0c01ad43df7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:50.027672 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f2a67fb6-d3e1-4858-b4e1-e0c01ad43df7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:50.039287 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f2a67fb6-d3e1-4858-b4e1-e0c01ad43df7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.265044 Aug 26 18:24:50.039949 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 93/192] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:49 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:51.063865 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-71038eb5-6ebd-4e21-b709-a98da9d5c31e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:51.064473 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-71038eb5-6ebd-4e21-b709-a98da9d5c31e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:51.071220 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71038eb5-6ebd-4e21-b709-a98da9d5c31e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:51.071779 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71038eb5-6ebd-4e21-b709-a98da9d5c31e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:51.072475 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71038eb5-6ebd-4e21-b709-a98da9d5c31e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:51.073322 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71038eb5-6ebd-4e21-b709-a98da9d5c31e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:51.073864 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71038eb5-6ebd-4e21-b709-a98da9d5c31e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:51.074348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71038eb5-6ebd-4e21-b709-a98da9d5c31e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:51.381404 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-71038eb5-6ebd-4e21-b709-a98da9d5c31e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:51.400012 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-71038eb5-6ebd-4e21-b709-a98da9d5c31e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.339903 Aug 26 18:24:51.401544 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 100/193] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:51 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:52.423414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d6897de0-b578-4c51-bf4e-92be0abbf89c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:52.424107 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-d6897de0-b578-4c51-bf4e-92be0abbf89c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:52.430091 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d6897de0-b578-4c51-bf4e-92be0abbf89c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:52.430746 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d6897de0-b578-4c51-bf4e-92be0abbf89c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:52.431390 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d6897de0-b578-4c51-bf4e-92be0abbf89c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:52.432158 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d6897de0-b578-4c51-bf4e-92be0abbf89c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:52.432614 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d6897de0-b578-4c51-bf4e-92be0abbf89c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:52.433253 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d6897de0-b578-4c51-bf4e-92be0abbf89c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:52.574443 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d6897de0-b578-4c51-bf4e-92be0abbf89c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:52.587597 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-d6897de0-b578-4c51-bf4e-92be0abbf89c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.167928 Aug 26 18:24:52.592656 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 94/194] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:52 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:24:53.615065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9d0c90c7-a6bf-43b7-9a8b-79b7c7c26032 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:53.616084 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9d0c90c7-a6bf-43b7-9a8b-79b7c7c26032 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:53.623917 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d0c90c7-a6bf-43b7-9a8b-79b7c7c26032 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:53.624689 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d0c90c7-a6bf-43b7-9a8b-79b7c7c26032 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:53.625296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d0c90c7-a6bf-43b7-9a8b-79b7c7c26032 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:53.626076 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d0c90c7-a6bf-43b7-9a8b-79b7c7c26032 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:53.626568 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d0c90c7-a6bf-43b7-9a8b-79b7c7c26032 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:53.627009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d0c90c7-a6bf-43b7-9a8b-79b7c7c26032 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:53.846862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9d0c90c7-a6bf-43b7-9a8b-79b7c7c26032 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:53.856212 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9d0c90c7-a6bf-43b7-9a8b-79b7c7c26032 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.245703 Aug 26 18:24:53.856989 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 101/195] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:53 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:54.878411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-b75be25c-fa82-4661-87b8-11a883e8d542 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:54.879691 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-b75be25c-fa82-4661-87b8-11a883e8d542 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:54.883117 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:24:54.886722 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b75be25c-fa82-4661-87b8-11a883e8d542 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:54.887460 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b75be25c-fa82-4661-87b8-11a883e8d542 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:54.896742 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b75be25c-fa82-4661-87b8-11a883e8d542 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:54.900061 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b75be25c-fa82-4661-87b8-11a883e8d542 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:54.901137 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b75be25c-fa82-4661-87b8-11a883e8d542 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:54.901726 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b75be25c-fa82-4661-87b8-11a883e8d542 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:55.064086 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b75be25c-fa82-4661-87b8-11a883e8d542 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:55.074081 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-b75be25c-fa82-4661-87b8-11a883e8d542 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.199932 Aug 26 18:24:55.077345 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 95/196] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:54 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:24:56.099810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8380eb72-671a-44a3-a2f2-43aa87f7d826 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:56.100528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8380eb72-671a-44a3-a2f2-43aa87f7d826 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:56.109070 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8380eb72-671a-44a3-a2f2-43aa87f7d826 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:56.109736 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8380eb72-671a-44a3-a2f2-43aa87f7d826 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:56.111991 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8380eb72-671a-44a3-a2f2-43aa87f7d826 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:56.112935 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8380eb72-671a-44a3-a2f2-43aa87f7d826 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:56.115558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8380eb72-671a-44a3-a2f2-43aa87f7d826 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:56.116138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8380eb72-671a-44a3-a2f2-43aa87f7d826 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:56.388751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8380eb72-671a-44a3-a2f2-43aa87f7d826 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:56.398307 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8380eb72-671a-44a3-a2f2-43aa87f7d826 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.304370 Aug 26 18:24:56.399142 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 102/197] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:56 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:57.423462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c1b57d0c-1f39-44f2-a189-e6ec7185aca6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:57.424082 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c1b57d0c-1f39-44f2-a189-e6ec7185aca6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:57.435968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1b57d0c-1f39-44f2-a189-e6ec7185aca6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:57.436465 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1b57d0c-1f39-44f2-a189-e6ec7185aca6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:57.436929 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1b57d0c-1f39-44f2-a189-e6ec7185aca6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:57.437640 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1b57d0c-1f39-44f2-a189-e6ec7185aca6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:57.441099 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1b57d0c-1f39-44f2-a189-e6ec7185aca6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:57.441997 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1b57d0c-1f39-44f2-a189-e6ec7185aca6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:57.809634 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c1b57d0c-1f39-44f2-a189-e6ec7185aca6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:57.826758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c1b57d0c-1f39-44f2-a189-e6ec7185aca6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.406709 Aug 26 18:24:57.841907 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 96/198] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:57 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:24:58.770918 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-871241247", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "networks": [{"uuid": "6d96113a-46f7-4b66-b00e-f8e82a2ea71e"}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:58.852537 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-10260dd5-c9e9-44b6-a518-4032a4dd3c01 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:24:58.853448 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-10260dd5-c9e9-44b6-a518-4032a4dd3c01 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:24:58.864486 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-10260dd5-c9e9-44b6-a518-4032a4dd3c01 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:58.865107 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-10260dd5-c9e9-44b6-a518-4032a4dd3c01 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:58.867758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-10260dd5-c9e9-44b6-a518-4032a4dd3c01 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:58.868743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-10260dd5-c9e9-44b6-a518-4032a4dd3c01 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:58.872512 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-10260dd5-c9e9-44b6-a518-4032a4dd3c01 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:58.875612 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-10260dd5-c9e9-44b6-a518-4032a4dd3c01 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:58.892739 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] validate_networks() for [('6d96113a-46f7-4b66-b00e-f8e82a2ea71e', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:24:59.238947 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-10260dd5-c9e9-44b6-a518-4032a4dd3c01 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:24:59.248384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-10260dd5-c9e9-44b6-a518-4032a4dd3c01 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.400434 Aug 26 18:24:59.251323 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 97/199] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:58 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:24:59.804002 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:24:59.805846 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:24:59.806628 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:24:59.807183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:24:59.807827 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:24:59.826688 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:59.827520 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:59.827950 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:59.828666 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:24:59.829169 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:24:59.829942 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:24:59.849487 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Getting quotas for project 62a8ceb72d38430da081bf1a280ec13a. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:24:59.850457 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-20e0cab5-a7ae-4cfc-af37-e0fa1e8828ea tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Action: 'create', calling method: .version_select at 0x7fc744320dc0>, body: {"keypair": {"name": "tempest-keypair-2064446139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzKipE03dI65iSv08gNgPN8JpwuUulv5Otn2ryU8SWaIbe+NrpNyEvKOU2akwftirgRhRCvYt9+l/rSGRA33RgnlH/Lf/108cJtE+Zu5vNnj60wA5LumCFTbLkVit12rA=="}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:24:59.854443 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Getting quotas for user 9b559d3676324d118771e07248aee539 and project 62a8ceb72d38430da081bf1a280ec13a. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:24:59.878375 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:24:59.881649 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:24:59.889090 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-20e0cab5-a7ae-4cfc-af37-e0fa1e8828ea tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'key_pairs'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:24:59.895069 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-20e0cab5-a7ae-4cfc-af37-e0fa1e8828ea tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for user a1be02f9e7fd4bdabc05ec48e2a35f56 and project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'key_pairs'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:24:59.939883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-20e0cab5-a7ae-4cfc-af37-e0fa1e8828ea tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.391976 Aug 26 18:24:59.941246 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 98/200] 10.222.0.45 () {60 vars in 1159 bytes} [Fri Aug 26 18:24:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:24:59.989977 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7eca2d35-7e38-4cac-8eb5-5813a26086d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.223951 Aug 26 18:24:59.990973 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 103/201] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:24:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 18:25:00.003571 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-19f1b5f7-343f-4fdd-bd86-76fd6c900174 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:00.004808 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-19f1b5f7-343f-4fdd-bd86-76fd6c900174 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:00.106296 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-19f1b5f7-343f-4fdd-bd86-76fd6c900174 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:00.115660 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-19f1b5f7-343f-4fdd-bd86-76fd6c900174 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1213 microversion: 2.1 time: 0.117692 Aug 26 18:25:00.116930 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 99/202] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:24:59 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:00.280021 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cbc26ecc-7dbb-4425-b250-ae5a40519269 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:00.280641 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cbc26ecc-7dbb-4425-b250-ae5a40519269 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:00.304618 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbc26ecc-7dbb-4425-b250-ae5a40519269 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:00.305181 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbc26ecc-7dbb-4425-b250-ae5a40519269 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:00.305603 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbc26ecc-7dbb-4425-b250-ae5a40519269 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:00.306322 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbc26ecc-7dbb-4425-b250-ae5a40519269 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:00.307390 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbc26ecc-7dbb-4425-b250-ae5a40519269 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:00.307813 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbc26ecc-7dbb-4425-b250-ae5a40519269 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:00.722053 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cbc26ecc-7dbb-4425-b250-ae5a40519269 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:00.741338 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cbc26ecc-7dbb-4425-b250-ae5a40519269 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.469410 Aug 26 18:25:00.746401 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 104/203] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:00 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:01.137956 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ff253162-a591-40cb-be21-727f1531f8bc tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:01.138577 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ff253162-a591-40cb-be21-727f1531f8bc tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:01.169295 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ff253162-a591-40cb-be21-727f1531f8bc tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:01.171037 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ff253162-a591-40cb-be21-727f1531f8bc tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:01.172230 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ff253162-a591-40cb-be21-727f1531f8bc tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:01.174873 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ff253162-a591-40cb-be21-727f1531f8bc tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:01.175575 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ff253162-a591-40cb-be21-727f1531f8bc tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:01.176457 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ff253162-a591-40cb-be21-727f1531f8bc tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:01.332150 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ff253162-a591-40cb-be21-727f1531f8bc tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:01.345203 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ff253162-a591-40cb-be21-727f1531f8bc tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1209 microversion: 2.1 time: 0.211218 Aug 26 18:25:01.346191 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 100/204] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:01 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1209 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:01.767076 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4c872009-61be-4be9-ac91-a6e6ce365f93 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:01.767951 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4c872009-61be-4be9-ac91-a6e6ce365f93 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:01.777294 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c872009-61be-4be9-ac91-a6e6ce365f93 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:01.777794 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c872009-61be-4be9-ac91-a6e6ce365f93 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:01.778303 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c872009-61be-4be9-ac91-a6e6ce365f93 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:01.786347 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c872009-61be-4be9-ac91-a6e6ce365f93 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:01.787161 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c872009-61be-4be9-ac91-a6e6ce365f93 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:01.787802 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c872009-61be-4be9-ac91-a6e6ce365f93 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:02.036454 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4c872009-61be-4be9-ac91-a6e6ce365f93 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:02.053407 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4c872009-61be-4be9-ac91-a6e6ce365f93 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.290369 Aug 26 18:25:02.054180 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 105/205] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:01 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:02.369670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-71b4aa50-b48f-432c-8c93-fe5222b9cf01 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:02.371877 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-71b4aa50-b48f-432c-8c93-fe5222b9cf01 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:02.383871 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-71b4aa50-b48f-432c-8c93-fe5222b9cf01 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:02.384697 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-71b4aa50-b48f-432c-8c93-fe5222b9cf01 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:02.385503 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-71b4aa50-b48f-432c-8c93-fe5222b9cf01 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:02.386433 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-71b4aa50-b48f-432c-8c93-fe5222b9cf01 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:02.387175 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-71b4aa50-b48f-432c-8c93-fe5222b9cf01 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:02.388153 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-71b4aa50-b48f-432c-8c93-fe5222b9cf01 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:02.440116 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-602617488", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d4880b7-d8b8-43ef-a723-cbc27eb026db"}], "security_groups": [{"name": "tempest-securitygroup--1663775680"}], "key_name": "tempest-keypair-2064446139", "user_data": "}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:02.508475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-71b4aa50-b48f-432c-8c93-fe5222b9cf01 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:02.540602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-71b4aa50-b48f-432c-8c93-fe5222b9cf01 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1283 microversion: 2.1 time: 0.174682 Aug 26 18:25:02.541697 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 101/206] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:02 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1283 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:02.666686 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] validate_networks() for [('2d4880b7-d8b8-43ef-a723-cbc27eb026db', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:25:03.081547 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1437847e-b98f-4e26-a4c1-6942ddeb8709 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:03.082964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1437847e-b98f-4e26-a4c1-6942ddeb8709 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:03.090290 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1437847e-b98f-4e26-a4c1-6942ddeb8709 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:03.090986 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1437847e-b98f-4e26-a4c1-6942ddeb8709 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:03.091664 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1437847e-b98f-4e26-a4c1-6942ddeb8709 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:03.092505 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1437847e-b98f-4e26-a4c1-6942ddeb8709 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:03.093181 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1437847e-b98f-4e26-a4c1-6942ddeb8709 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:03.093738 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1437847e-b98f-4e26-a4c1-6942ddeb8709 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:03.250146 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1437847e-b98f-4e26-a4c1-6942ddeb8709 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:03.259623 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1437847e-b98f-4e26-a4c1-6942ddeb8709 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.182242 Aug 26 18:25:03.261580 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 102/207] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:03 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:03.356018 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:25:03.359806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:25:03.360394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:25:03.360861 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:25:03.361279 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:25:03.372470 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:03.373199 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:03.373777 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:03.374702 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:03.375579 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:03.376305 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:03.399048 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:25:03.413050 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for user a1be02f9e7fd4bdabc05ec48e2a35f56 and project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:25:03.428933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:25:03.432019 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:25:03.504397 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-76ef815b-ffc0-4363-8ca1-deaab11145ed tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.069154 Aug 26 18:25:03.505654 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 106/208] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:25:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 18:25:03.516808 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4f7ab4ec-eb93-44cb-b313-3e87a793b807 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:03.518012 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4f7ab4ec-eb93-44cb-b313-3e87a793b807 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:03.563946 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-79d0eebe-ea44-42b3-b1bd-bcb638f634c5 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:03.564560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-79d0eebe-ea44-42b3-b1bd-bcb638f634c5 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:03.585655 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-79d0eebe-ea44-42b3-b1bd-bcb638f634c5 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:03.589345 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-79d0eebe-ea44-42b3-b1bd-bcb638f634c5 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:03.589810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-79d0eebe-ea44-42b3-b1bd-bcb638f634c5 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:03.591443 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-4f7ab4ec-eb93-44cb-b313-3e87a793b807 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:03.591597 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-79d0eebe-ea44-42b3-b1bd-bcb638f634c5 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:03.593346 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-79d0eebe-ea44-42b3-b1bd-bcb638f634c5 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:03.593989 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-79d0eebe-ea44-42b3-b1bd-bcb638f634c5 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:03.599892 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4f7ab4ec-eb93-44cb-b313-3e87a793b807 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1241 microversion: 2.1 time: 0.087481 Aug 26 18:25:03.603530 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 103/209] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:03 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:03.851518 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-79d0eebe-ea44-42b3-b1bd-bcb638f634c5 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:03.863477 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-79d0eebe-ea44-42b3-b1bd-bcb638f634c5 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1313 microversion: 2.1 time: 0.303436 Aug 26 18:25:03.865091 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 107/210] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:03 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:04.283412 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-3c730a49-4706-4a2c-a33b-332d1ac83513 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:04.284124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-3c730a49-4706-4a2c-a33b-332d1ac83513 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:04.290874 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3c730a49-4706-4a2c-a33b-332d1ac83513 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:04.291603 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3c730a49-4706-4a2c-a33b-332d1ac83513 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:04.292188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3c730a49-4706-4a2c-a33b-332d1ac83513 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:04.292935 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3c730a49-4706-4a2c-a33b-332d1ac83513 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:04.293529 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3c730a49-4706-4a2c-a33b-332d1ac83513 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:04.294142 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3c730a49-4706-4a2c-a33b-332d1ac83513 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:04.319133 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:04.500147 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3c730a49-4706-4a2c-a33b-332d1ac83513 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:04.525741 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-3c730a49-4706-4a2c-a33b-332d1ac83513 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.245572 Aug 26 18:25:04.527019 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 104/211] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:04 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:04.636345 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8f1813d5-65ff-4905-812e-5651959433a3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:04.637080 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8f1813d5-65ff-4905-812e-5651959433a3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:04.670334 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f1813d5-65ff-4905-812e-5651959433a3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:04.672128 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f1813d5-65ff-4905-812e-5651959433a3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:04.672973 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f1813d5-65ff-4905-812e-5651959433a3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:04.675593 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f1813d5-65ff-4905-812e-5651959433a3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:04.676309 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f1813d5-65ff-4905-812e-5651959433a3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:04.678689 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f1813d5-65ff-4905-812e-5651959433a3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:04.824461 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8f1813d5-65ff-4905-812e-5651959433a3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:04.834643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8f1813d5-65ff-4905-812e-5651959433a3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1237 microversion: 2.1 time: 0.215308 Aug 26 18:25:04.835233 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 108/212] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:04 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1237 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:04.890434 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0e7e0013-bfc6-47f5-9f12-8c2ff8a07dbf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:04.892060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-0e7e0013-bfc6-47f5-9f12-8c2ff8a07dbf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:04.923340 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0e7e0013-bfc6-47f5-9f12-8c2ff8a07dbf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:04.924541 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0e7e0013-bfc6-47f5-9f12-8c2ff8a07dbf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:04.925006 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0e7e0013-bfc6-47f5-9f12-8c2ff8a07dbf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:04.928015 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0e7e0013-bfc6-47f5-9f12-8c2ff8a07dbf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:04.930026 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0e7e0013-bfc6-47f5-9f12-8c2ff8a07dbf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:04.932069 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0e7e0013-bfc6-47f5-9f12-8c2ff8a07dbf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:05.120270 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0e7e0013-bfc6-47f5-9f12-8c2ff8a07dbf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:05.132203 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-0e7e0013-bfc6-47f5-9f12-8c2ff8a07dbf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1313 microversion: 2.1 time: 0.249475 Aug 26 18:25:05.133106 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 105/213] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:04 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:05.349695 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-0a67963a-8566-4ddc-a516-08c3fa27bb7b req-4e5c4ba6-f737-44ba-a5a9-b5842b6331fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a08efbc8-b2e6-41c8-855d-2f6870567f23", "tag": "c7bd6820-c908-461a-84db-eda4150d4e87"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:05.360066 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0a67963a-8566-4ddc-a516-08c3fa27bb7b req-4e5c4ba6-f737-44ba-a5a9-b5842b6331fe service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:05.360610 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0a67963a-8566-4ddc-a516-08c3fa27bb7b req-4e5c4ba6-f737-44ba-a5a9-b5842b6331fe service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:05.361475 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0a67963a-8566-4ddc-a516-08c3fa27bb7b req-4e5c4ba6-f737-44ba-a5a9-b5842b6331fe service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:05.378197 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-0a67963a-8566-4ddc-a516-08c3fa27bb7b req-4e5c4ba6-f737-44ba-a5a9-b5842b6331fe service nova] Creating event network-changed:c7bd6820-c908-461a-84db-eda4150d4e87 for instance a08efbc8-b2e6-41c8-855d-2f6870567f23 on hv-cinder-85199 Aug 26 18:25:05.383703 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-0a67963a-8566-4ddc-a516-08c3fa27bb7b req-4e5c4ba6-f737-44ba-a5a9-b5842b6331fe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038561 Aug 26 18:25:05.384358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 109/214] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:25:05.547532 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0f7a8f62-c088-40de-bbba-21e91d210f95 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:05.548143 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-0f7a8f62-c088-40de-bbba-21e91d210f95 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:05.555056 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0f7a8f62-c088-40de-bbba-21e91d210f95 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:05.555542 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0f7a8f62-c088-40de-bbba-21e91d210f95 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:05.556142 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0f7a8f62-c088-40de-bbba-21e91d210f95 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:05.557018 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0f7a8f62-c088-40de-bbba-21e91d210f95 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:05.557626 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0f7a8f62-c088-40de-bbba-21e91d210f95 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:05.558322 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0f7a8f62-c088-40de-bbba-21e91d210f95 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:05.709261 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0f7a8f62-c088-40de-bbba-21e91d210f95 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:05.717856 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-0f7a8f62-c088-40de-bbba-21e91d210f95 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1523 microversion: 2.1 time: 0.174525 Aug 26 18:25:05.718731 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 106/215] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:05 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:05.857812 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d06c9b03-5e63-4e52-b64f-aa5aa13b7e9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:05.858636 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d06c9b03-5e63-4e52-b64f-aa5aa13b7e9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:05.867969 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d06c9b03-5e63-4e52-b64f-aa5aa13b7e9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:05.868507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d06c9b03-5e63-4e52-b64f-aa5aa13b7e9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:05.868993 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d06c9b03-5e63-4e52-b64f-aa5aa13b7e9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:05.869724 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d06c9b03-5e63-4e52-b64f-aa5aa13b7e9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:05.870173 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d06c9b03-5e63-4e52-b64f-aa5aa13b7e9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:05.870615 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d06c9b03-5e63-4e52-b64f-aa5aa13b7e9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:05.938399 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d06c9b03-5e63-4e52-b64f-aa5aa13b7e9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:05.946314 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d06c9b03-5e63-4e52-b64f-aa5aa13b7e9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1293 microversion: 2.1 time: 0.094438 Aug 26 18:25:05.947042 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 110/216] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:05 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:06.156200 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-6f3fdc79-d67e-4b99-9043-d121c1a08959 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:06.166397 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-6f3fdc79-d67e-4b99-9043-d121c1a08959 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:06.179182 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f3fdc79-d67e-4b99-9043-d121c1a08959 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:06.180065 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f3fdc79-d67e-4b99-9043-d121c1a08959 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:06.180739 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f3fdc79-d67e-4b99-9043-d121c1a08959 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:06.181647 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f3fdc79-d67e-4b99-9043-d121c1a08959 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:06.182349 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f3fdc79-d67e-4b99-9043-d121c1a08959 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:06.183325 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f3fdc79-d67e-4b99-9043-d121c1a08959 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:06.326564 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6f3fdc79-d67e-4b99-9043-d121c1a08959 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:06.334370 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-6f3fdc79-d67e-4b99-9043-d121c1a08959 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1313 microversion: 2.1 time: 0.183808 Aug 26 18:25:06.334936 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 107/217] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:06 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:06.739469 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2fb2a987-7b74-4784-8a3b-d593bde752e7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:06.739995 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2fb2a987-7b74-4784-8a3b-d593bde752e7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:06.742032 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:06.747458 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fb2a987-7b74-4784-8a3b-d593bde752e7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:06.747938 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fb2a987-7b74-4784-8a3b-d593bde752e7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:06.748369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fb2a987-7b74-4784-8a3b-d593bde752e7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:06.749111 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fb2a987-7b74-4784-8a3b-d593bde752e7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:06.749561 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fb2a987-7b74-4784-8a3b-d593bde752e7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:06.749979 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fb2a987-7b74-4784-8a3b-d593bde752e7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:06.968420 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-930bf720-4e86-4341-a8e3-82161b431b26 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:06.969436 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-930bf720-4e86-4341-a8e3-82161b431b26 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:06.976225 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-930bf720-4e86-4341-a8e3-82161b431b26 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:06.977415 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-930bf720-4e86-4341-a8e3-82161b431b26 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:06.977936 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-930bf720-4e86-4341-a8e3-82161b431b26 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:06.978899 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-930bf720-4e86-4341-a8e3-82161b431b26 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:06.979451 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-930bf720-4e86-4341-a8e3-82161b431b26 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:06.979942 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-930bf720-4e86-4341-a8e3-82161b431b26 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:07.048203 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2fb2a987-7b74-4784-8a3b-d593bde752e7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:07.065093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2fb2a987-7b74-4784-8a3b-d593bde752e7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1503 microversion: 2.1 time: 0.329566 Aug 26 18:25:07.065664 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 111/218] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:06 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1503 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:07.076568 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-930bf720-4e86-4341-a8e3-82161b431b26 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:07.085016 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6fd3ecbc-9b03-4ddb-89fd-bc74d63c8890 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:07.085883 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6fd3ecbc-9b03-4ddb-89fd-bc74d63c8890 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:07.091251 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-930bf720-4e86-4341-a8e3-82161b431b26 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1299 microversion: 2.1 time: 0.121834 Aug 26 18:25:07.092232 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 108/219] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:06 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1299 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:07.092829 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd3ecbc-9b03-4ddb-89fd-bc74d63c8890 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:07.093500 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd3ecbc-9b03-4ddb-89fd-bc74d63c8890 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:07.094138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd3ecbc-9b03-4ddb-89fd-bc74d63c8890 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:07.095037 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd3ecbc-9b03-4ddb-89fd-bc74d63c8890 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:07.095493 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd3ecbc-9b03-4ddb-89fd-bc74d63c8890 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:07.095910 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd3ecbc-9b03-4ddb-89fd-bc74d63c8890 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:07.299701 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6fd3ecbc-9b03-4ddb-89fd-bc74d63c8890 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:07.309526 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6fd3ecbc-9b03-4ddb-89fd-bc74d63c8890 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1515 microversion: 2.1 time: 0.228138 Aug 26 18:25:07.310573 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 112/220] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:07 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:07.354445 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-79f58f16-8893-423f-89de-e874e10dbbd8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:07.355416 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-79f58f16-8893-423f-89de-e874e10dbbd8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:07.362884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79f58f16-8893-423f-89de-e874e10dbbd8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:07.363435 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79f58f16-8893-423f-89de-e874e10dbbd8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:07.363943 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79f58f16-8893-423f-89de-e874e10dbbd8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:07.364756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79f58f16-8893-423f-89de-e874e10dbbd8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:07.365255 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79f58f16-8893-423f-89de-e874e10dbbd8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:07.365735 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79f58f16-8893-423f-89de-e874e10dbbd8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:07.602165 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-79f58f16-8893-423f-89de-e874e10dbbd8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:07.613779 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-79f58f16-8893-423f-89de-e874e10dbbd8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1313 microversion: 2.1 time: 0.262900 Aug 26 18:25:07.614927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 109/221] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:07 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:08.115888 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-827a3790-28fd-46a6-8b94-f1388c347a5f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:08.116455 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-827a3790-28fd-46a6-8b94-f1388c347a5f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:08.123704 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-827a3790-28fd-46a6-8b94-f1388c347a5f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:08.124217 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-827a3790-28fd-46a6-8b94-f1388c347a5f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:08.124689 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-827a3790-28fd-46a6-8b94-f1388c347a5f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:08.125423 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-827a3790-28fd-46a6-8b94-f1388c347a5f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:08.125873 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-827a3790-28fd-46a6-8b94-f1388c347a5f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:08.126291 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-827a3790-28fd-46a6-8b94-f1388c347a5f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:08.262461 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-827a3790-28fd-46a6-8b94-f1388c347a5f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:08.270902 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-827a3790-28fd-46a6-8b94-f1388c347a5f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1367 microversion: 2.1 time: 0.159344 Aug 26 18:25:08.271758 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 113/222] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:08 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:08.384599 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-3d3396e4-684e-42a3-8961-dfa34b365ce7 req-b1788253-a70d-4095-92ef-6dc8e57f02c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0359a4-7ac3-470c-8fe7-31ed2faab28b", "tag": "0e69f390-da67-404b-8373-cd4efa3a40cb"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:08.394563 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-3d3396e4-684e-42a3-8961-dfa34b365ce7 req-b1788253-a70d-4095-92ef-6dc8e57f02c2 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:08.395032 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-3d3396e4-684e-42a3-8961-dfa34b365ce7 req-b1788253-a70d-4095-92ef-6dc8e57f02c2 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:08.395453 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-3d3396e4-684e-42a3-8961-dfa34b365ce7 req-b1788253-a70d-4095-92ef-6dc8e57f02c2 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:08.406618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-3d3396e4-684e-42a3-8961-dfa34b365ce7 req-b1788253-a70d-4095-92ef-6dc8e57f02c2 service nova] Creating event network-changed:0e69f390-da67-404b-8373-cd4efa3a40cb for instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b on hv-cinder-85199 Aug 26 18:25:08.412237 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-3d3396e4-684e-42a3-8961-dfa34b365ce7 req-b1788253-a70d-4095-92ef-6dc8e57f02c2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031677 Aug 26 18:25:08.412863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 110/223] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:25:08.636268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-72760442-a098-4344-8bfc-306b9af6f6be tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:08.636875 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-72760442-a098-4344-8bfc-306b9af6f6be tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:08.643570 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72760442-a098-4344-8bfc-306b9af6f6be tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:08.644057 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72760442-a098-4344-8bfc-306b9af6f6be tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:08.644518 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72760442-a098-4344-8bfc-306b9af6f6be tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:08.645227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72760442-a098-4344-8bfc-306b9af6f6be tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:08.645704 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72760442-a098-4344-8bfc-306b9af6f6be tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:08.646130 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72760442-a098-4344-8bfc-306b9af6f6be tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:08.777559 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-72760442-a098-4344-8bfc-306b9af6f6be tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:08.785600 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-72760442-a098-4344-8bfc-306b9af6f6be tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1313 microversion: 2.1 time: 0.153899 Aug 26 18:25:08.786346 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 114/224] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:08 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:08.826828 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4e21307e-a448-48cc-a263-a502655b4a72 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:08.829190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4e21307e-a448-48cc-a263-a502655b4a72 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:08.835291 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4e21307e-a448-48cc-a263-a502655b4a72 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:08.835766 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4e21307e-a448-48cc-a263-a502655b4a72 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:08.836195 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4e21307e-a448-48cc-a263-a502655b4a72 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:08.836909 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4e21307e-a448-48cc-a263-a502655b4a72 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:08.837354 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4e21307e-a448-48cc-a263-a502655b4a72 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:08.837770 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4e21307e-a448-48cc-a263-a502655b4a72 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:08.860087 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-4e21307e-a448-48cc-a263-a502655b4a72 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lazy-loading 'flavor' on Instance uuid 6249cc1c-c171-41b8-81d5-2d73ed7735be {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:25:08.937259 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4e21307e-a448-48cc-a263-a502655b4a72 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "POST /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be/action" status: 200 len: 32 microversion: 2.1 time: 0.114586 Aug 26 18:25:08.937872 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 111/225] 10.222.0.45 () {60 vars in 1278 bytes} [Fri Aug 26 18:25:08 2022] POST /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be/action => generated 32 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 18:25:08.948100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-691219eb-837e-490f-906c-cd121bb65634 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:08.948965 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-691219eb-837e-490f-906c-cd121bb65634 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:08.956291 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-691219eb-837e-490f-906c-cd121bb65634 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:08.956814 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-691219eb-837e-490f-906c-cd121bb65634 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:08.957238 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-691219eb-837e-490f-906c-cd121bb65634 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:08.957942 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-691219eb-837e-490f-906c-cd121bb65634 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:08.958383 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-691219eb-837e-490f-906c-cd121bb65634 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:08.958795 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-691219eb-837e-490f-906c-cd121bb65634 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:08.961665 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:09.101840 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-691219eb-837e-490f-906c-cd121bb65634 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:09.110033 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-691219eb-837e-490f-906c-cd121bb65634 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.166351 Aug 26 18:25:09.110826 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 115/226] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:08 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:09.292235 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-fb76d48a-2413-470b-b15d-ed4a722221d3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:09.292968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-fb76d48a-2413-470b-b15d-ed4a722221d3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:09.301229 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fb76d48a-2413-470b-b15d-ed4a722221d3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:09.302432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fb76d48a-2413-470b-b15d-ed4a722221d3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:09.303193 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fb76d48a-2413-470b-b15d-ed4a722221d3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:09.304577 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fb76d48a-2413-470b-b15d-ed4a722221d3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:09.305110 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fb76d48a-2413-470b-b15d-ed4a722221d3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:09.305725 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fb76d48a-2413-470b-b15d-ed4a722221d3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:09.461725 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-fb76d48a-2413-470b-b15d-ed4a722221d3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:09.470187 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-fb76d48a-2413-470b-b15d-ed4a722221d3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1367 microversion: 2.1 time: 0.182318 Aug 26 18:25:09.472608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 112/227] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:09 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:09.809007 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c0e757d0-3c6a-4300-a703-1060cd624d20 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:09.809625 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c0e757d0-3c6a-4300-a703-1060cd624d20 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:09.818615 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0e757d0-3c6a-4300-a703-1060cd624d20 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:09.819262 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0e757d0-3c6a-4300-a703-1060cd624d20 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:09.819797 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0e757d0-3c6a-4300-a703-1060cd624d20 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:09.820823 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0e757d0-3c6a-4300-a703-1060cd624d20 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:09.821419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0e757d0-3c6a-4300-a703-1060cd624d20 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:09.822022 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0e757d0-3c6a-4300-a703-1060cd624d20 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:09.956771 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c0e757d0-3c6a-4300-a703-1060cd624d20 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:09.964565 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c0e757d0-3c6a-4300-a703-1060cd624d20 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1313 microversion: 2.1 time: 0.160848 Aug 26 18:25:09.967033 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 116/228] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:09 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:10.142052 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c3505bb1-5ac5-43a7-85fc-b70a6f32474f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:10.142669 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c3505bb1-5ac5-43a7-85fc-b70a6f32474f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:10.149199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c3505bb1-5ac5-43a7-85fc-b70a6f32474f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:10.149708 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c3505bb1-5ac5-43a7-85fc-b70a6f32474f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:10.150201 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c3505bb1-5ac5-43a7-85fc-b70a6f32474f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:10.151010 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c3505bb1-5ac5-43a7-85fc-b70a6f32474f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:10.151469 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c3505bb1-5ac5-43a7-85fc-b70a6f32474f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:10.151892 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c3505bb1-5ac5-43a7-85fc-b70a6f32474f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:10.287303 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c3505bb1-5ac5-43a7-85fc-b70a6f32474f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:10.295349 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c3505bb1-5ac5-43a7-85fc-b70a6f32474f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.157574 Aug 26 18:25:10.295948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 113/229] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:10 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:10.493149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5c3801fe-7278-4957-b106-67658f372660 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:10.493840 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5c3801fe-7278-4957-b106-67658f372660 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:10.500205 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c3801fe-7278-4957-b106-67658f372660 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:10.500809 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c3801fe-7278-4957-b106-67658f372660 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:10.501301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c3801fe-7278-4957-b106-67658f372660 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:10.502047 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c3801fe-7278-4957-b106-67658f372660 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:10.502565 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c3801fe-7278-4957-b106-67658f372660 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:10.503050 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c3801fe-7278-4957-b106-67658f372660 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:10.636389 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5c3801fe-7278-4957-b106-67658f372660 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:10.646064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5c3801fe-7278-4957-b106-67658f372660 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1367 microversion: 2.1 time: 0.156849 Aug 26 18:25:10.646924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 117/230] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:10 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:10.987090 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-20836c4e-5f09-498b-bfac-a0fd35908b54 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:10.987682 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-20836c4e-5f09-498b-bfac-a0fd35908b54 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:10.993939 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20836c4e-5f09-498b-bfac-a0fd35908b54 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:10.994411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20836c4e-5f09-498b-bfac-a0fd35908b54 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:10.994837 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20836c4e-5f09-498b-bfac-a0fd35908b54 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:10.995514 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20836c4e-5f09-498b-bfac-a0fd35908b54 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:10.995959 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20836c4e-5f09-498b-bfac-a0fd35908b54 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:10.996373 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20836c4e-5f09-498b-bfac-a0fd35908b54 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:11.135349 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-20836c4e-5f09-498b-bfac-a0fd35908b54 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:11.144050 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-20836c4e-5f09-498b-bfac-a0fd35908b54 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1313 microversion: 2.1 time: 0.160762 Aug 26 18:25:11.144771 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 114/231] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:10 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:11.315754 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3b288ee2-8da2-41b7-b9ba-36aea2173eb3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:11.316285 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3b288ee2-8da2-41b7-b9ba-36aea2173eb3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:11.323033 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b288ee2-8da2-41b7-b9ba-36aea2173eb3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:11.323592 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b288ee2-8da2-41b7-b9ba-36aea2173eb3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:11.324021 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b288ee2-8da2-41b7-b9ba-36aea2173eb3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:11.324708 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b288ee2-8da2-41b7-b9ba-36aea2173eb3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:11.325261 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b288ee2-8da2-41b7-b9ba-36aea2173eb3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:11.325677 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b288ee2-8da2-41b7-b9ba-36aea2173eb3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:11.470150 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3b288ee2-8da2-41b7-b9ba-36aea2173eb3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:11.479192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3b288ee2-8da2-41b7-b9ba-36aea2173eb3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.167398 Aug 26 18:25:11.480183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 118/232] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:11 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:11.667611 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ac1bff7e-1069-4ce2-8d96-51e33f0c63c9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:11.668144 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ac1bff7e-1069-4ce2-8d96-51e33f0c63c9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:11.674708 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ac1bff7e-1069-4ce2-8d96-51e33f0c63c9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:11.675186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ac1bff7e-1069-4ce2-8d96-51e33f0c63c9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:11.675603 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ac1bff7e-1069-4ce2-8d96-51e33f0c63c9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:11.676282 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ac1bff7e-1069-4ce2-8d96-51e33f0c63c9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:11.676743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ac1bff7e-1069-4ce2-8d96-51e33f0c63c9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:11.677165 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ac1bff7e-1069-4ce2-8d96-51e33f0c63c9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:11.816153 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ac1bff7e-1069-4ce2-8d96-51e33f0c63c9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:11.823868 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ac1bff7e-1069-4ce2-8d96-51e33f0c63c9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1367 microversion: 2.1 time: 0.160267 Aug 26 18:25:11.824430 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 115/233] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:11 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:12.165877 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1ca5e4d2-af51-41fc-9641-ee1723eed312 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:12.166492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1ca5e4d2-af51-41fc-9641-ee1723eed312 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:12.173638 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ca5e4d2-af51-41fc-9641-ee1723eed312 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:12.174154 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ca5e4d2-af51-41fc-9641-ee1723eed312 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:12.174586 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ca5e4d2-af51-41fc-9641-ee1723eed312 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:12.175343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ca5e4d2-af51-41fc-9641-ee1723eed312 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:12.176302 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ca5e4d2-af51-41fc-9641-ee1723eed312 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:12.176741 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ca5e4d2-af51-41fc-9641-ee1723eed312 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:12.319206 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1ca5e4d2-af51-41fc-9641-ee1723eed312 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:12.328339 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1ca5e4d2-af51-41fc-9641-ee1723eed312 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1313 microversion: 2.1 time: 0.166252 Aug 26 18:25:12.328961 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 119/234] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:12 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:12.501071 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-72480f27-88c9-412b-8d59-ecef71f8b60d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:12.501610 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-72480f27-88c9-412b-8d59-ecef71f8b60d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:12.511365 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-72480f27-88c9-412b-8d59-ecef71f8b60d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:12.511857 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-72480f27-88c9-412b-8d59-ecef71f8b60d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:12.512327 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-72480f27-88c9-412b-8d59-ecef71f8b60d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:12.513064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-72480f27-88c9-412b-8d59-ecef71f8b60d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:12.513515 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-72480f27-88c9-412b-8d59-ecef71f8b60d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:12.513938 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-72480f27-88c9-412b-8d59-ecef71f8b60d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:12.651298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-72480f27-88c9-412b-8d59-ecef71f8b60d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:12.659931 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-72480f27-88c9-412b-8d59-ecef71f8b60d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.163261 Aug 26 18:25:12.660517 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 116/235] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:12 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:12.760756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-5a13f473-e57e-4f6f-873b-5e2da66c081c req-a7c4ff16-b009-4127-befd-8833972f6088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08efbc8-b2e6-41c8-855d-2f6870567f23", "name": "network-vif-plugged", "status": "completed", "tag": "c7bd6820-c908-461a-84db-eda4150d4e87"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:12.771418 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-5a13f473-e57e-4f6f-873b-5e2da66c081c req-a7c4ff16-b009-4127-befd-8833972f6088 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:12.771987 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-5a13f473-e57e-4f6f-873b-5e2da66c081c req-a7c4ff16-b009-4127-befd-8833972f6088 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:12.774236 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-5a13f473-e57e-4f6f-873b-5e2da66c081c req-a7c4ff16-b009-4127-befd-8833972f6088 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:12.788971 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-5a13f473-e57e-4f6f-873b-5e2da66c081c req-a7c4ff16-b009-4127-befd-8833972f6088 service nova] Creating event network-vif-plugged:c7bd6820-c908-461a-84db-eda4150d4e87 for instance a08efbc8-b2e6-41c8-855d-2f6870567f23 on hv-cinder-85199 Aug 26 18:25:12.794456 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-5a13f473-e57e-4f6f-873b-5e2da66c081c req-a7c4ff16-b009-4127-befd-8833972f6088 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037734 Aug 26 18:25:12.795426 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 120/236] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:25:12.844286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-3f66a484-6265-4dd8-9b62-3e6d19700709 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:12.845672 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-3f66a484-6265-4dd8-9b62-3e6d19700709 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:12.852102 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3f66a484-6265-4dd8-9b62-3e6d19700709 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:12.852591 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3f66a484-6265-4dd8-9b62-3e6d19700709 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:12.853053 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3f66a484-6265-4dd8-9b62-3e6d19700709 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:12.853748 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3f66a484-6265-4dd8-9b62-3e6d19700709 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:12.854194 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3f66a484-6265-4dd8-9b62-3e6d19700709 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:12.854613 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3f66a484-6265-4dd8-9b62-3e6d19700709 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:13.048583 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3f66a484-6265-4dd8-9b62-3e6d19700709 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:13.056742 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-3f66a484-6265-4dd8-9b62-3e6d19700709 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1367 microversion: 2.1 time: 0.216462 Aug 26 18:25:13.064668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 117/237] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:12 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:13.350984 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-746b261b-0e29-4717-b415-98eaf3c05ae6 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:13.351546 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-746b261b-0e29-4717-b415-98eaf3c05ae6 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:13.358503 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-746b261b-0e29-4717-b415-98eaf3c05ae6 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:13.358976 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-746b261b-0e29-4717-b415-98eaf3c05ae6 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:13.359397 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-746b261b-0e29-4717-b415-98eaf3c05ae6 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:13.360076 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-746b261b-0e29-4717-b415-98eaf3c05ae6 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:13.360516 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-746b261b-0e29-4717-b415-98eaf3c05ae6 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:13.360954 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-746b261b-0e29-4717-b415-98eaf3c05ae6 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:13.393521 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=4 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:13.422573 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=12 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:13.500405 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-746b261b-0e29-4717-b415-98eaf3c05ae6 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:13.508348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-746b261b-0e29-4717-b415-98eaf3c05ae6 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1313 microversion: 2.1 time: 0.162176 Aug 26 18:25:13.509007 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 121/238] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:13 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:13.681732 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d0c658b2-1fa2-4b3c-b4af-c438226c657e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:13.682343 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-d0c658b2-1fa2-4b3c-b4af-c438226c657e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:13.684431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=8 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:13.690234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d0c658b2-1fa2-4b3c-b4af-c438226c657e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:13.690743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d0c658b2-1fa2-4b3c-b4af-c438226c657e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:13.691201 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d0c658b2-1fa2-4b3c-b4af-c438226c657e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:13.691929 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d0c658b2-1fa2-4b3c-b4af-c438226c657e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:13.692402 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d0c658b2-1fa2-4b3c-b4af-c438226c657e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:13.692871 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d0c658b2-1fa2-4b3c-b4af-c438226c657e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:13.828033 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d0c658b2-1fa2-4b3c-b4af-c438226c657e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:13.835887 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-d0c658b2-1fa2-4b3c-b4af-c438226c657e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.158304 Aug 26 18:25:13.836462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 118/239] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:13 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:14.076920 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-42dd6cd4-3fb3-4478-867d-31d533322cb5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:14.077525 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-42dd6cd4-3fb3-4478-867d-31d533322cb5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:14.087573 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42dd6cd4-3fb3-4478-867d-31d533322cb5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:14.088480 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42dd6cd4-3fb3-4478-867d-31d533322cb5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:14.089164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42dd6cd4-3fb3-4478-867d-31d533322cb5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:14.090224 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42dd6cd4-3fb3-4478-867d-31d533322cb5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:14.090794 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42dd6cd4-3fb3-4478-867d-31d533322cb5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:14.091226 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42dd6cd4-3fb3-4478-867d-31d533322cb5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:14.236402 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-42dd6cd4-3fb3-4478-867d-31d533322cb5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:14.245238 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-42dd6cd4-3fb3-4478-867d-31d533322cb5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1367 microversion: 2.1 time: 0.172087 Aug 26 18:25:14.248780 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 122/240] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:14 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:14.529707 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ea6b4414-affb-4414-a4cf-8955bf4db789 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:14.530347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ea6b4414-affb-4414-a4cf-8955bf4db789 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:14.536580 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ea6b4414-affb-4414-a4cf-8955bf4db789 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:14.537130 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ea6b4414-affb-4414-a4cf-8955bf4db789 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:14.537581 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ea6b4414-affb-4414-a4cf-8955bf4db789 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:14.538277 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ea6b4414-affb-4414-a4cf-8955bf4db789 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:14.538769 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ea6b4414-affb-4414-a4cf-8955bf4db789 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:14.539199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ea6b4414-affb-4414-a4cf-8955bf4db789 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:14.681306 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ea6b4414-affb-4414-a4cf-8955bf4db789 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:14.688649 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:14.694995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ea6b4414-affb-4414-a4cf-8955bf4db789 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1313 microversion: 2.1 time: 0.169317 Aug 26 18:25:14.695626 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 119/241] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:14 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:14.822807 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-ba99ace8-f040-4a6e-82be-e68334a6174f req-bb67b147-a08a-47f1-beb7-5af6b9c932eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0359a4-7ac3-470c-8fe7-31ed2faab28b", "name": "network-vif-plugged", "status": "completed", "tag": "0e69f390-da67-404b-8373-cd4efa3a40cb"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:14.837106 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ba99ace8-f040-4a6e-82be-e68334a6174f req-bb67b147-a08a-47f1-beb7-5af6b9c932eb service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:14.837725 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ba99ace8-f040-4a6e-82be-e68334a6174f req-bb67b147-a08a-47f1-beb7-5af6b9c932eb service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:14.838298 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ba99ace8-f040-4a6e-82be-e68334a6174f req-bb67b147-a08a-47f1-beb7-5af6b9c932eb service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:14.853228 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-ba99ace8-f040-4a6e-82be-e68334a6174f req-bb67b147-a08a-47f1-beb7-5af6b9c932eb service nova] Creating event network-vif-plugged:0e69f390-da67-404b-8373-cd4efa3a40cb for instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b on hv-cinder-85199 Aug 26 18:25:14.858110 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-ba99ace8-f040-4a6e-82be-e68334a6174f req-bb67b147-a08a-47f1-beb7-5af6b9c932eb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041261 Aug 26 18:25:14.858690 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 123/242] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:25:14.859356 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-dea4ae24-f7a5-40df-83e1-5185eb7d0b63 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:14.859956 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-dea4ae24-f7a5-40df-83e1-5185eb7d0b63 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:14.867193 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dea4ae24-f7a5-40df-83e1-5185eb7d0b63 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:14.867670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dea4ae24-f7a5-40df-83e1-5185eb7d0b63 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:14.868189 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dea4ae24-f7a5-40df-83e1-5185eb7d0b63 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:14.868901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dea4ae24-f7a5-40df-83e1-5185eb7d0b63 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:14.869342 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dea4ae24-f7a5-40df-83e1-5185eb7d0b63 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:14.869750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dea4ae24-f7a5-40df-83e1-5185eb7d0b63 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:15.001381 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-dea4ae24-f7a5-40df-83e1-5185eb7d0b63 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:15.010459 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-dea4ae24-f7a5-40df-83e1-5185eb7d0b63 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.156785 Aug 26 18:25:15.020940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 120/243] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:14 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:15.268197 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f38331cb-ce90-4e29-86e5-83032caa91ea tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:15.268918 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f38331cb-ce90-4e29-86e5-83032caa91ea tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:15.275233 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f38331cb-ce90-4e29-86e5-83032caa91ea tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:15.275721 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f38331cb-ce90-4e29-86e5-83032caa91ea tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:15.276174 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f38331cb-ce90-4e29-86e5-83032caa91ea tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:15.276901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f38331cb-ce90-4e29-86e5-83032caa91ea tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:15.277354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f38331cb-ce90-4e29-86e5-83032caa91ea tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:15.277808 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f38331cb-ce90-4e29-86e5-83032caa91ea tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:15.416261 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f38331cb-ce90-4e29-86e5-83032caa91ea tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:15.424328 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f38331cb-ce90-4e29-86e5-83032caa91ea tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1367 microversion: 2.1 time: 0.160512 Aug 26 18:25:15.424936 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 124/244] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:15 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:15.715876 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9a8c6b66-8ec6-441d-9e2c-656581faf05d tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:15.716496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9a8c6b66-8ec6-441d-9e2c-656581faf05d tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:15.724459 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a8c6b66-8ec6-441d-9e2c-656581faf05d tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:15.724971 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a8c6b66-8ec6-441d-9e2c-656581faf05d tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:15.725411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a8c6b66-8ec6-441d-9e2c-656581faf05d tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:15.726106 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a8c6b66-8ec6-441d-9e2c-656581faf05d tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:15.726842 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a8c6b66-8ec6-441d-9e2c-656581faf05d tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:15.727267 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a8c6b66-8ec6-441d-9e2c-656581faf05d tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:15.881767 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9a8c6b66-8ec6-441d-9e2c-656581faf05d tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:15.891058 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9a8c6b66-8ec6-441d-9e2c-656581faf05d tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1498 microversion: 2.1 time: 0.179075 Aug 26 18:25:15.891608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 121/245] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:15 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1498 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:16.032431 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1348f2ab-2ff5-422d-9fea-bc9b83647ec3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:16.033345 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1348f2ab-2ff5-422d-9fea-bc9b83647ec3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:16.039847 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1348f2ab-2ff5-422d-9fea-bc9b83647ec3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:16.040266 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1348f2ab-2ff5-422d-9fea-bc9b83647ec3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:16.040699 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1348f2ab-2ff5-422d-9fea-bc9b83647ec3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:16.041483 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1348f2ab-2ff5-422d-9fea-bc9b83647ec3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:16.041963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1348f2ab-2ff5-422d-9fea-bc9b83647ec3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:16.042385 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1348f2ab-2ff5-422d-9fea-bc9b83647ec3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:16.184639 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1348f2ab-2ff5-422d-9fea-bc9b83647ec3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:16.200469 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1348f2ab-2ff5-422d-9fea-bc9b83647ec3 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.172515 Aug 26 18:25:16.201118 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 125/246] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:16 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:16.401527 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-01acdedf-cac4-4ea2-9138-4803ae6ac6a7 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:16.402025 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-01acdedf-cac4-4ea2-9138-4803ae6ac6a7 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:16.408327 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-01acdedf-cac4-4ea2-9138-4803ae6ac6a7 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:16.408845 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-01acdedf-cac4-4ea2-9138-4803ae6ac6a7 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:16.409254 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-01acdedf-cac4-4ea2-9138-4803ae6ac6a7 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:16.409933 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-01acdedf-cac4-4ea2-9138-4803ae6ac6a7 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:16.410382 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-01acdedf-cac4-4ea2-9138-4803ae6ac6a7 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:16.410790 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-01acdedf-cac4-4ea2-9138-4803ae6ac6a7 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:16.436252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-01acdedf-cac4-4ea2-9138-4803ae6ac6a7 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Going to try to terminate instance {{(pid=120540) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:25:16.446691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bed35e26-7453-423a-a39b-27464335ad24 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:16.447775 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bed35e26-7453-423a-a39b-27464335ad24 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:16.455084 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bed35e26-7453-423a-a39b-27464335ad24 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:16.455638 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bed35e26-7453-423a-a39b-27464335ad24 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:16.456130 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bed35e26-7453-423a-a39b-27464335ad24 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:16.456910 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bed35e26-7453-423a-a39b-27464335ad24 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:16.457436 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bed35e26-7453-423a-a39b-27464335ad24 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:16.458018 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bed35e26-7453-423a-a39b-27464335ad24 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:16.533545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-01acdedf-cac4-4ea2-9138-4803ae6ac6a7 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 204 len: 0 microversion: 2.1 time: 0.134522 Aug 26 18:25:16.537692 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 122/247] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:25:16 2022] DELETE /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:25:16.544681 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-23df6888-dcdf-4490-aa9b-6ab5500744d4 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:16.545352 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-23df6888-dcdf-4490-aa9b-6ab5500744d4 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:16.551433 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23df6888-dcdf-4490-aa9b-6ab5500744d4 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:16.552101 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23df6888-dcdf-4490-aa9b-6ab5500744d4 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:16.552688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23df6888-dcdf-4490-aa9b-6ab5500744d4 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:16.553510 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23df6888-dcdf-4490-aa9b-6ab5500744d4 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:16.554038 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23df6888-dcdf-4490-aa9b-6ab5500744d4 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:16.554468 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23df6888-dcdf-4490-aa9b-6ab5500744d4 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:16.617057 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bed35e26-7453-423a-a39b-27464335ad24 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:16.625363 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bed35e26-7453-423a-a39b-27464335ad24 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1367 microversion: 2.1 time: 0.183361 Aug 26 18:25:16.632750 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 126/248] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:16 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:16.696248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-23df6888-dcdf-4490-aa9b-6ab5500744d4 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:16.705312 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-23df6888-dcdf-4490-aa9b-6ab5500744d4 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1504 microversion: 2.1 time: 0.165867 Aug 26 18:25:16.705907 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 123/249] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:16 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:17.222648 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f64532ad-6c6e-4ed4-a642-26ea1105f952 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:17.223256 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f64532ad-6c6e-4ed4-a642-26ea1105f952 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:17.231598 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f64532ad-6c6e-4ed4-a642-26ea1105f952 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:17.232384 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f64532ad-6c6e-4ed4-a642-26ea1105f952 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:17.233103 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f64532ad-6c6e-4ed4-a642-26ea1105f952 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:17.234106 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f64532ad-6c6e-4ed4-a642-26ea1105f952 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:17.234577 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f64532ad-6c6e-4ed4-a642-26ea1105f952 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:17.235194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f64532ad-6c6e-4ed4-a642-26ea1105f952 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:17.377447 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f64532ad-6c6e-4ed4-a642-26ea1105f952 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:17.385089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f64532ad-6c6e-4ed4-a642-26ea1105f952 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.166275 Aug 26 18:25:17.385654 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 127/250] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:17 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:17.646533 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c2ec789b-d244-4e7e-bb7e-33bce74a20eb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:17.647063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c2ec789b-d244-4e7e-bb7e-33bce74a20eb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:17.652844 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2ec789b-d244-4e7e-bb7e-33bce74a20eb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:17.653693 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2ec789b-d244-4e7e-bb7e-33bce74a20eb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:17.654328 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2ec789b-d244-4e7e-bb7e-33bce74a20eb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:17.655210 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2ec789b-d244-4e7e-bb7e-33bce74a20eb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:17.655878 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2ec789b-d244-4e7e-bb7e-33bce74a20eb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:17.656497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2ec789b-d244-4e7e-bb7e-33bce74a20eb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:17.729469 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4983383f-c5f1-4c4d-825e-374081027d9a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:17.730166 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4983383f-c5f1-4c4d-825e-374081027d9a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:17.736100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4983383f-c5f1-4c4d-825e-374081027d9a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:17.736928 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4983383f-c5f1-4c4d-825e-374081027d9a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:17.737429 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4983383f-c5f1-4c4d-825e-374081027d9a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:17.738424 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4983383f-c5f1-4c4d-825e-374081027d9a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:17.738946 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4983383f-c5f1-4c4d-825e-374081027d9a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:17.739429 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4983383f-c5f1-4c4d-825e-374081027d9a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:17.885692 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4983383f-c5f1-4c4d-825e-374081027d9a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:17.897987 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4983383f-c5f1-4c4d-825e-374081027d9a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1504 microversion: 2.1 time: 0.174111 Aug 26 18:25:17.914628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c2ec789b-d244-4e7e-bb7e-33bce74a20eb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:17.920964 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 128/251] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:17 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:17.923536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c2ec789b-d244-4e7e-bb7e-33bce74a20eb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1367 microversion: 2.1 time: 0.280822 Aug 26 18:25:17.924269 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 124/252] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:17 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:18.407991 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6564b13b-37d4-4ead-accf-7e281481f2cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:18.408765 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6564b13b-37d4-4ead-accf-7e281481f2cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:18.415308 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6564b13b-37d4-4ead-accf-7e281481f2cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:18.415801 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6564b13b-37d4-4ead-accf-7e281481f2cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:18.416230 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6564b13b-37d4-4ead-accf-7e281481f2cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:18.416972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6564b13b-37d4-4ead-accf-7e281481f2cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:18.417420 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6564b13b-37d4-4ead-accf-7e281481f2cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:18.418025 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6564b13b-37d4-4ead-accf-7e281481f2cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:18.564910 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6564b13b-37d4-4ead-accf-7e281481f2cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:18.573449 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6564b13b-37d4-4ead-accf-7e281481f2cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.169781 Aug 26 18:25:18.574036 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 129/253] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:18 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:18.919695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c053e2d2-cf70-4028-966a-cec0bab279f8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:18.920947 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c053e2d2-cf70-4028-966a-cec0bab279f8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:18.928085 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c053e2d2-cf70-4028-966a-cec0bab279f8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:18.929031 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c053e2d2-cf70-4028-966a-cec0bab279f8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:18.929647 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c053e2d2-cf70-4028-966a-cec0bab279f8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:18.930623 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c053e2d2-cf70-4028-966a-cec0bab279f8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:18.930991 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c053e2d2-cf70-4028-966a-cec0bab279f8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:18.931413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c053e2d2-cf70-4028-966a-cec0bab279f8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:18.943641 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b171e278-6a18-4050-a962-935b6fe970ae tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:18.945022 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b171e278-6a18-4050-a962-935b6fe970ae tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:18.954464 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b171e278-6a18-4050-a962-935b6fe970ae tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:18.955568 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b171e278-6a18-4050-a962-935b6fe970ae tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:18.956250 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b171e278-6a18-4050-a962-935b6fe970ae tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:18.957474 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b171e278-6a18-4050-a962-935b6fe970ae tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:18.958140 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b171e278-6a18-4050-a962-935b6fe970ae tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:18.958983 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b171e278-6a18-4050-a962-935b6fe970ae tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:19.109343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b171e278-6a18-4050-a962-935b6fe970ae tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:19.117922 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b171e278-6a18-4050-a962-935b6fe970ae tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1557 microversion: 2.1 time: 0.178296 Aug 26 18:25:19.118539 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 130/254] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:18 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1557 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:19.142006 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-092ed38a-e523-4736-a031-14e2349ef89d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:19.142568 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-092ed38a-e523-4736-a031-14e2349ef89d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:19.148911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-092ed38a-e523-4736-a031-14e2349ef89d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:19.149391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-092ed38a-e523-4736-a031-14e2349ef89d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:19.150029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-092ed38a-e523-4736-a031-14e2349ef89d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:19.150738 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-092ed38a-e523-4736-a031-14e2349ef89d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:19.151192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-092ed38a-e523-4736-a031-14e2349ef89d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:19.151782 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-092ed38a-e523-4736-a031-14e2349ef89d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:19.250565 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-092ed38a-e523-4736-a031-14e2349ef89d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115137 Aug 26 18:25:19.252550 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 131/255] 10.222.0.45 () {58 vars in 1275 bytes} [Fri Aug 26 18:25:19 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:25:19.550215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c053e2d2-cf70-4028-966a-cec0bab279f8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:19.559294 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c053e2d2-cf70-4028-966a-cec0bab279f8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1504 microversion: 2.1 time: 0.643949 Aug 26 18:25:19.566208 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 125/256] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:18 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1504 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:19.599655 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d1387f0b-8d68-400a-8900-c46bcc3c89cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:19.602299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d1387f0b-8d68-400a-8900-c46bcc3c89cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:19.611223 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1387f0b-8d68-400a-8900-c46bcc3c89cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:19.612077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1387f0b-8d68-400a-8900-c46bcc3c89cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:19.612743 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1387f0b-8d68-400a-8900-c46bcc3c89cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:19.613589 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1387f0b-8d68-400a-8900-c46bcc3c89cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:19.614125 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1387f0b-8d68-400a-8900-c46bcc3c89cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:19.614804 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1387f0b-8d68-400a-8900-c46bcc3c89cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:19.901657 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d1387f0b-8d68-400a-8900-c46bcc3c89cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:19.922029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d1387f0b-8d68-400a-8900-c46bcc3c89cd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.330561 Aug 26 18:25:19.933844 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 132/257] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:19 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:20.159459 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-d7b47e91-5fbf-48c1-bc1e-98e60696a856 req-21f10d2e-419c-4b85-a1c1-611ff8e3fc47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08efbc8-b2e6-41c8-855d-2f6870567f23", "name": "network-vif-deleted", "tag": "c7bd6820-c908-461a-84db-eda4150d4e87"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:20.184845 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-d7b47e91-5fbf-48c1-bc1e-98e60696a856 req-21f10d2e-419c-4b85-a1c1-611ff8e3fc47 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:20.185594 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-d7b47e91-5fbf-48c1-bc1e-98e60696a856 req-21f10d2e-419c-4b85-a1c1-611ff8e3fc47 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:20.186096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-d7b47e91-5fbf-48c1-bc1e-98e60696a856 req-21f10d2e-419c-4b85-a1c1-611ff8e3fc47 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:20.203905 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-d7b47e91-5fbf-48c1-bc1e-98e60696a856 req-21f10d2e-419c-4b85-a1c1-611ff8e3fc47 service nova] Creating event network-vif-deleted:c7bd6820-c908-461a-84db-eda4150d4e87 for instance a08efbc8-b2e6-41c8-855d-2f6870567f23 on hv-cinder-85199 Aug 26 18:25:20.209380 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-d7b47e91-5fbf-48c1-bc1e-98e60696a856 req-21f10d2e-419c-4b85-a1c1-611ff8e3fc47 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053827 Aug 26 18:25:20.210816 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 126/258] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:25:20.581313 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f5bd3f8c-62a1-46d8-b212-590d02651faf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:20.582197 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f5bd3f8c-62a1-46d8-b212-590d02651faf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:20.596781 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5bd3f8c-62a1-46d8-b212-590d02651faf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:20.597381 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5bd3f8c-62a1-46d8-b212-590d02651faf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:20.597884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5bd3f8c-62a1-46d8-b212-590d02651faf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:20.599019 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5bd3f8c-62a1-46d8-b212-590d02651faf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:20.599548 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5bd3f8c-62a1-46d8-b212-590d02651faf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:20.600254 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5bd3f8c-62a1-46d8-b212-590d02651faf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:20.650496 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:20.674249 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-c4ed6d95-7bb9-4460-a700-110621628e09 req-b1ab9669-1e1a-4d25-9802-dbc951150dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0359a4-7ac3-470c-8fe7-31ed2faab28b", "tag": "0e69f390-da67-404b-8373-cd4efa3a40cb"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:20.686203 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5bd3f8c-62a1-46d8-b212-590d02651faf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:20.688248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-c4ed6d95-7bb9-4460-a700-110621628e09 req-b1ab9669-1e1a-4d25-9802-dbc951150dc2 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:20.689278 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-c4ed6d95-7bb9-4460-a700-110621628e09 req-b1ab9669-1e1a-4d25-9802-dbc951150dc2 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:20.689984 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-c4ed6d95-7bb9-4460-a700-110621628e09 req-b1ab9669-1e1a-4d25-9802-dbc951150dc2 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:20.693719 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5bd3f8c-62a1-46d8-b212-590d02651faf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:20.694208 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5bd3f8c-62a1-46d8-b212-590d02651faf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:20.694693 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-f5bd3f8c-62a1-46d8-b212-590d02651faf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lazy-loading 'fault' on Instance uuid a08efbc8-b2e6-41c8-855d-2f6870567f23 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:25:20.704802 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-c4ed6d95-7bb9-4460-a700-110621628e09 req-b1ab9669-1e1a-4d25-9802-dbc951150dc2 service nova] Creating event network-changed:0e69f390-da67-404b-8373-cd4efa3a40cb for instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b on hv-cinder-85199 Aug 26 18:25:20.714095 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-c4ed6d95-7bb9-4460-a700-110621628e09 req-b1ab9669-1e1a-4d25-9802-dbc951150dc2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043579 Aug 26 18:25:20.715765 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 127/259] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:25:20.753473 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f5bd3f8c-62a1-46d8-b212-590d02651faf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:20.763315 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f5bd3f8c-62a1-46d8-b212-590d02651faf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 200 len: 1303 microversion: 2.1 time: 0.186104 Aug 26 18:25:20.777641 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 133/260] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:20 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 1303 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:20.956696 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-fcbfdff4-ff32-4d85-baf0-60132851c6c5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:20.957412 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-fcbfdff4-ff32-4d85-baf0-60132851c6c5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:20.968199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fcbfdff4-ff32-4d85-baf0-60132851c6c5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:20.968681 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fcbfdff4-ff32-4d85-baf0-60132851c6c5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:20.971219 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fcbfdff4-ff32-4d85-baf0-60132851c6c5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:20.972103 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fcbfdff4-ff32-4d85-baf0-60132851c6c5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:20.974456 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fcbfdff4-ff32-4d85-baf0-60132851c6c5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:20.974888 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fcbfdff4-ff32-4d85-baf0-60132851c6c5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:21.305494 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-fcbfdff4-ff32-4d85-baf0-60132851c6c5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:21.313980 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-fcbfdff4-ff32-4d85-baf0-60132851c6c5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.361969 Aug 26 18:25:21.314572 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 128/261] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:20 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:21.789568 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2a7c6000-9a01-442a-92e4-7fdb12da7a98 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:21.790945 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2a7c6000-9a01-442a-92e4-7fdb12da7a98 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: a08efbc8-b2e6-41c8-855d-2f6870567f23] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:21.801264 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a7c6000-9a01-442a-92e4-7fdb12da7a98 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:21.802205 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a7c6000-9a01-442a-92e4-7fdb12da7a98 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:21.803153 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a7c6000-9a01-442a-92e4-7fdb12da7a98 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:21.813145 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a7c6000-9a01-442a-92e4-7fdb12da7a98 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:21.813869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a7c6000-9a01-442a-92e4-7fdb12da7a98 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:21.814629 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a7c6000-9a01-442a-92e4-7fdb12da7a98 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:21.875918 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-2a7c6000-9a01-442a-92e4-7fdb12da7a98 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] HTTP exception thrown: Instance a08efbc8-b2e6-41c8-855d-2f6870567f23 could not be found. Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2a7c6000-9a01-442a-92e4-7fdb12da7a98 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Request method failure captured: Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 HTTP/1.1 Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ_4QCg9JuPAQZM5wIHivYkMpUaBP0tCmRo5uUcb3EXzWNds8Fe9hFyaMaeICPf72eRA1n1F-cfpYPQ3q9Wcr6fcWLp3IOgJKgp3oAYItep3ct3NBUrzV8Wt0HwHoZe45f6Jxv8AGy7t3lhbGVKv1IpjJXL1VANAiFWN3RmGHYe8uww Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 62a8ceb72d38430da081bf1a280ec13a Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesActionsTest-2127694618 Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:25:21.877747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:25:21.879283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_62a8ceb72d38430da081bf1a280ec13a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62a8ceb72d38430da081bf1a280ec13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62a8ceb72d38430da081bf1a280ec13a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/62a8ceb72d38430da081bf1a280ec13a"}]}] Aug 26 18:25:21.879283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesActionsTest-2127694618 Aug 26 18:25:21.879283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 62a8ceb72d38430da081bf1a280ec13a Aug 26 18:25:21.879283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesActionsTest-2127694618 Aug 26 18:25:21.879283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesActionsTest-2127694618-project Aug 26 18:25:21.879283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:25:21.879283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:25:21.879283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: 9b559d3676324d118771e07248aee539 Aug 26 18:25:21.879283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesActionsTest-2127694618-project Aug 26 18:25:21.879283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:25:21.879283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance a08efbc8-b2e6-41c8-855d-2f6870567f23 could not be found. Aug 26 18:25:21.879283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': 'a08efbc8-b2e6-41c8-855d-2f6870567f23'} Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a08efbc8-b2e6-41c8-855d-2f6870567f23 could not be found. Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:25:21.880183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a08efbc8-b2e6-41c8-855d-2f6870567f23 could not be found. Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a08efbc8-b2e6-41c8-855d-2f6870567f23 could not be found. Aug 26 18:25:21.881788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:25:21.883016 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2a7c6000-9a01-442a-92e4-7fdb12da7a98 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Returning 404 to user: Instance a08efbc8-b2e6-41c8-855d-2f6870567f23 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:25:21.883804 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2a7c6000-9a01-442a-92e4-7fdb12da7a98 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23" status: 404 len: 111 microversion: 2.1 time: 0.100761 Aug 26 18:25:21.884457 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 134/262] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:21 2022] GET /compute/v2.1/servers/a08efbc8-b2e6-41c8-855d-2f6870567f23 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:25:22.018852 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1474628573", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "networks": [{"uuid": "6d96113a-46f7-4b66-b00e-f8e82a2ea71e"}]}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:22.078325 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.network.neutron [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] validate_networks() for [('6d96113a-46f7-4b66-b00e-f8e82a2ea71e', None, None, None, None, None)] {{(pid=120540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:25:22.335181 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e2e0baef-f5ef-4562-a364-a9f7e4d10160 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:22.336064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e2e0baef-f5ef-4562-a364-a9f7e4d10160 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:22.342997 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2e0baef-f5ef-4562-a364-a9f7e4d10160 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:22.343685 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2e0baef-f5ef-4562-a364-a9f7e4d10160 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:22.344437 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2e0baef-f5ef-4562-a364-a9f7e4d10160 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:22.345367 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2e0baef-f5ef-4562-a364-a9f7e4d10160 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:22.346283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2e0baef-f5ef-4562-a364-a9f7e4d10160 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:22.346874 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2e0baef-f5ef-4562-a364-a9f7e4d10160 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:22.521085 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e2e0baef-f5ef-4562-a364-a9f7e4d10160 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:22.532477 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e2e0baef-f5ef-4562-a364-a9f7e4d10160 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.200811 Aug 26 18:25:22.545180 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 135/263] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:22 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:22.882385 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Flavor limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:25:22.882836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Image limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:25:22.883260 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Flavor pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:25:22.883687 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Image pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:25:22.884094 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:25:22.893583 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:22.894065 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:22.894493 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:22.895219 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:22.895669 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:22.896087 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:22.914076 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Getting quotas for project 62a8ceb72d38430da081bf1a280ec13a. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:25:22.918272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Getting quotas for user 9b559d3676324d118771e07248aee539 and project 62a8ceb72d38430da081bf1a280ec13a. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:25:22.930963 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Going to run 1 instances... {{(pid=120540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:25:22.933284 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:25:22.945083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:22.984182 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9a9fd546-5e14-4692-b452-e28b8ff55490 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.969536 Aug 26 18:25:22.990795 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 129/264] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:25:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 18:25:23.004555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d2ca6fc0-5775-419d-bb20-c82c7be69d72 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:23.007364 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d2ca6fc0-5775-419d-bb20-c82c7be69d72 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:23.095322 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d2ca6fc0-5775-419d-bb20-c82c7be69d72 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:23.103114 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d2ca6fc0-5775-419d-bb20-c82c7be69d72 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1214 microversion: 2.1 time: 0.109747 Aug 26 18:25:23.103686 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 136/265] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:22 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:23.553942 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-41014d8b-7d1e-4f21-8074-42d463dd08d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:23.555178 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-41014d8b-7d1e-4f21-8074-42d463dd08d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:23.562101 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-41014d8b-7d1e-4f21-8074-42d463dd08d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:23.562582 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-41014d8b-7d1e-4f21-8074-42d463dd08d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:23.563536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-41014d8b-7d1e-4f21-8074-42d463dd08d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:23.564286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-41014d8b-7d1e-4f21-8074-42d463dd08d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:23.564770 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-41014d8b-7d1e-4f21-8074-42d463dd08d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:23.565175 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-41014d8b-7d1e-4f21-8074-42d463dd08d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:23.756541 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-41014d8b-7d1e-4f21-8074-42d463dd08d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:23.766681 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-41014d8b-7d1e-4f21-8074-42d463dd08d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.216925 Aug 26 18:25:23.768021 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 130/266] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:23 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:24.123615 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-53ab2eea-fc7b-4898-9456-bf228585b392 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:24.124319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-53ab2eea-fc7b-4898-9456-bf228585b392 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:24.132546 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ab2eea-fc7b-4898-9456-bf228585b392 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:24.133324 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ab2eea-fc7b-4898-9456-bf228585b392 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:24.133858 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ab2eea-fc7b-4898-9456-bf228585b392 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:24.134622 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ab2eea-fc7b-4898-9456-bf228585b392 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:24.135270 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ab2eea-fc7b-4898-9456-bf228585b392 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:24.135764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ab2eea-fc7b-4898-9456-bf228585b392 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:24.232333 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-53ab2eea-fc7b-4898-9456-bf228585b392 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:24.242579 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-53ab2eea-fc7b-4898-9456-bf228585b392 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1266 microversion: 2.1 time: 0.122707 Aug 26 18:25:24.243151 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 137/267] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:24 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1266 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:24.789886 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-babc58c8-e413-4ecd-bef6-9afb8787bd5b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:24.790597 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-babc58c8-e413-4ecd-bef6-9afb8787bd5b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:24.801776 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-babc58c8-e413-4ecd-bef6-9afb8787bd5b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:24.802296 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-babc58c8-e413-4ecd-bef6-9afb8787bd5b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:24.803417 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-babc58c8-e413-4ecd-bef6-9afb8787bd5b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:24.804129 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-babc58c8-e413-4ecd-bef6-9afb8787bd5b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:24.804574 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-babc58c8-e413-4ecd-bef6-9afb8787bd5b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:24.805512 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-babc58c8-e413-4ecd-bef6-9afb8787bd5b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:25.130909 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-babc58c8-e413-4ecd-bef6-9afb8787bd5b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:25.139136 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-babc58c8-e413-4ecd-bef6-9afb8787bd5b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.354148 Aug 26 18:25:25.139714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 131/268] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:24 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:25.263439 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-352f78f2-4dac-4466-b9fd-cc1e48f786af tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:25.264061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-352f78f2-4dac-4466-b9fd-cc1e48f786af tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:25.272844 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-352f78f2-4dac-4466-b9fd-cc1e48f786af tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:25.274374 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-352f78f2-4dac-4466-b9fd-cc1e48f786af tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:25.275579 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-352f78f2-4dac-4466-b9fd-cc1e48f786af tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:25.277296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-352f78f2-4dac-4466-b9fd-cc1e48f786af tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:25.278168 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-352f78f2-4dac-4466-b9fd-cc1e48f786af tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:25.278948 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-352f78f2-4dac-4466-b9fd-cc1e48f786af tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:25.369691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-352f78f2-4dac-4466-b9fd-cc1e48f786af tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:25.382782 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-352f78f2-4dac-4466-b9fd-cc1e48f786af tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1272 microversion: 2.1 time: 0.122992 Aug 26 18:25:25.397588 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 138/269] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:25 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:26.163805 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-50578add-9821-4938-a27a-2a26fb986dca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:26.164499 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-50578add-9821-4938-a27a-2a26fb986dca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:26.175038 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-50578add-9821-4938-a27a-2a26fb986dca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:26.175579 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-50578add-9821-4938-a27a-2a26fb986dca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:26.176615 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-50578add-9821-4938-a27a-2a26fb986dca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:26.177754 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-50578add-9821-4938-a27a-2a26fb986dca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:26.178369 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-50578add-9821-4938-a27a-2a26fb986dca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:26.178968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-50578add-9821-4938-a27a-2a26fb986dca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:26.405549 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e62924ad-a58a-4d5c-8140-80fb120ce79a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:26.406840 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e62924ad-a58a-4d5c-8140-80fb120ce79a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:26.418492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e62924ad-a58a-4d5c-8140-80fb120ce79a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:26.419744 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e62924ad-a58a-4d5c-8140-80fb120ce79a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:26.420829 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e62924ad-a58a-4d5c-8140-80fb120ce79a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:26.425505 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e62924ad-a58a-4d5c-8140-80fb120ce79a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:26.426043 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e62924ad-a58a-4d5c-8140-80fb120ce79a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:26.426535 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e62924ad-a58a-4d5c-8140-80fb120ce79a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:26.627003 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e62924ad-a58a-4d5c-8140-80fb120ce79a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:26.635442 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e62924ad-a58a-4d5c-8140-80fb120ce79a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1314 microversion: 2.1 time: 0.233840 Aug 26 18:25:26.636647 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 139/270] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:26 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:26.715682 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-50578add-9821-4938-a27a-2a26fb986dca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:26.724752 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-50578add-9821-4938-a27a-2a26fb986dca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.565106 Aug 26 18:25:26.726020 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 132/271] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:26 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:27.420181 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-520652d3-1a03-4832-a485-efad75b6bdad req-b9fe828a-0753-4520-ac15-f5fdaeb63fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a", "tag": "13682441-428e-4d86-b204-28aed368fd97"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:27.431119 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-520652d3-1a03-4832-a485-efad75b6bdad req-b9fe828a-0753-4520-ac15-f5fdaeb63fa0 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:27.431603 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-520652d3-1a03-4832-a485-efad75b6bdad req-b9fe828a-0753-4520-ac15-f5fdaeb63fa0 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:27.432158 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-520652d3-1a03-4832-a485-efad75b6bdad req-b9fe828a-0753-4520-ac15-f5fdaeb63fa0 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:27.444783 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-520652d3-1a03-4832-a485-efad75b6bdad req-b9fe828a-0753-4520-ac15-f5fdaeb63fa0 service nova] Creating event network-changed:13682441-428e-4d86-b204-28aed368fd97 for instance ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a on hv-cinder-85199 Aug 26 18:25:27.451274 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-520652d3-1a03-4832-a485-efad75b6bdad req-b9fe828a-0753-4520-ac15-f5fdaeb63fa0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034209 Aug 26 18:25:27.451409 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 140/272] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:25:27.662351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7ae6e30e-96ea-40d1-a3ff-44319acadb53 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:27.663593 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-7ae6e30e-96ea-40d1-a3ff-44319acadb53 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:27.673644 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7ae6e30e-96ea-40d1-a3ff-44319acadb53 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:27.677009 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7ae6e30e-96ea-40d1-a3ff-44319acadb53 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:27.677505 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7ae6e30e-96ea-40d1-a3ff-44319acadb53 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:27.680147 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7ae6e30e-96ea-40d1-a3ff-44319acadb53 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:27.680908 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7ae6e30e-96ea-40d1-a3ff-44319acadb53 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:27.681332 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7ae6e30e-96ea-40d1-a3ff-44319acadb53 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:27.750395 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f89b6747-232e-44d2-b4f7-560ca7e93188 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:27.751605 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f89b6747-232e-44d2-b4f7-560ca7e93188 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:27.758049 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f89b6747-232e-44d2-b4f7-560ca7e93188 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:27.758594 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f89b6747-232e-44d2-b4f7-560ca7e93188 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:27.759080 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f89b6747-232e-44d2-b4f7-560ca7e93188 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:27.759831 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f89b6747-232e-44d2-b4f7-560ca7e93188 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:27.760404 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f89b6747-232e-44d2-b4f7-560ca7e93188 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:27.760908 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f89b6747-232e-44d2-b4f7-560ca7e93188 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:27.901596 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f89b6747-232e-44d2-b4f7-560ca7e93188 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:27.910171 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f89b6747-232e-44d2-b4f7-560ca7e93188 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.164641 Aug 26 18:25:27.917062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 141/273] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:27 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:28.126550 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-7ae6e30e-96ea-40d1-a3ff-44319acadb53 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:28.134693 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-7ae6e30e-96ea-40d1-a3ff-44319acadb53 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1314 microversion: 2.1 time: 0.481135 Aug 26 18:25:28.135285 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 133/274] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:27 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:28.931447 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-884fe041-0276-45db-a900-0e110de15830 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:28.932803 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-884fe041-0276-45db-a900-0e110de15830 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:28.940119 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-884fe041-0276-45db-a900-0e110de15830 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:28.940597 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-884fe041-0276-45db-a900-0e110de15830 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:28.941043 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-884fe041-0276-45db-a900-0e110de15830 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:28.941907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-884fe041-0276-45db-a900-0e110de15830 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:28.942379 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-884fe041-0276-45db-a900-0e110de15830 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:28.943100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-884fe041-0276-45db-a900-0e110de15830 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:29.107946 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-884fe041-0276-45db-a900-0e110de15830 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:29.116806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-884fe041-0276-45db-a900-0e110de15830 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.188620 Aug 26 18:25:29.124908 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 142/275] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:28 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:29.157304 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c04b1143-076e-434d-9128-5126cede0b75 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:29.158900 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c04b1143-076e-434d-9128-5126cede0b75 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:29.166551 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c04b1143-076e-434d-9128-5126cede0b75 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:29.167308 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c04b1143-076e-434d-9128-5126cede0b75 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:29.167733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c04b1143-076e-434d-9128-5126cede0b75 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:29.168584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c04b1143-076e-434d-9128-5126cede0b75 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:29.169059 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c04b1143-076e-434d-9128-5126cede0b75 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:29.169513 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c04b1143-076e-434d-9128-5126cede0b75 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:29.363309 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fab105be-0fd3-478e-969b-8e3ca2163e64 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:29.364106 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fab105be-0fd3-478e-969b-8e3ca2163e64 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:29.376881 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fab105be-0fd3-478e-969b-8e3ca2163e64 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:29.377373 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fab105be-0fd3-478e-969b-8e3ca2163e64 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:29.377803 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fab105be-0fd3-478e-969b-8e3ca2163e64 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:29.378507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fab105be-0fd3-478e-969b-8e3ca2163e64 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:29.378953 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fab105be-0fd3-478e-969b-8e3ca2163e64 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:29.379371 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fab105be-0fd3-478e-969b-8e3ca2163e64 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:29.408783 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c04b1143-076e-434d-9128-5126cede0b75 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:29.413290 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fab105be-0fd3-478e-969b-8e3ca2163e64 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/ips" status: 200 len: 147 microversion: 2.1 time: 0.061163 Aug 26 18:25:29.419955 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 143/276] 10.222.0.45 () {58 vars in 1248 bytes} [Fri Aug 26 18:25:29 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/ips => generated 147 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:25:29.427795 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c04b1143-076e-434d-9128-5126cede0b75 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1314 microversion: 2.1 time: 0.274904 Aug 26 18:25:29.428375 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 134/277] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:29 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:29.748171 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-876a36b3-49bd-4825-87c5-55a1bf8fb5ee tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:29.748955 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-876a36b3-49bd-4825-87c5-55a1bf8fb5ee tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:29.756000 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-876a36b3-49bd-4825-87c5-55a1bf8fb5ee tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:29.756697 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-876a36b3-49bd-4825-87c5-55a1bf8fb5ee tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:29.757300 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-876a36b3-49bd-4825-87c5-55a1bf8fb5ee tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:29.758160 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-876a36b3-49bd-4825-87c5-55a1bf8fb5ee tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:29.758607 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-876a36b3-49bd-4825-87c5-55a1bf8fb5ee tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:29.759022 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-876a36b3-49bd-4825-87c5-55a1bf8fb5ee tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:29.793272 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-876a36b3-49bd-4825-87c5-55a1bf8fb5ee tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/ips" status: 200 len: 151 microversion: 2.20 time: 0.050254 Aug 26 18:25:29.794201 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 144/278] 10.222.0.45 () {60 vars in 1289 bytes} [Fri Aug 26 18:25:29 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:25:30.139732 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ec26055a-b99a-48ae-b14a-8b24e8e46882 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:30.140294 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ec26055a-b99a-48ae-b14a-8b24e8e46882 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:30.144382 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8da3b6a1-15fd-45af-88be-0a52912275b8 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Action: 'create', calling method: .version_select at 0x7fc74433bc10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1811114461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX7YE0X6Hjt9sxhQWqVuiHNqy8oQy9+FjTY0SWA9rytfZw6q+J4XBhdRMHYLw4/FUbGo/fwTXluGn2U5N1umHzeRy0a7zHQzKNNBJHawkXo56hQMjRZNF9hBrmi15e8Tw=="}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:30.153385 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec26055a-b99a-48ae-b14a-8b24e8e46882 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:30.153931 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec26055a-b99a-48ae-b14a-8b24e8e46882 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:30.154368 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec26055a-b99a-48ae-b14a-8b24e8e46882 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:30.155081 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec26055a-b99a-48ae-b14a-8b24e8e46882 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:30.155537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec26055a-b99a-48ae-b14a-8b24e8e46882 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:30.155959 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec26055a-b99a-48ae-b14a-8b24e8e46882 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:30.165494 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-8da3b6a1-15fd-45af-88be-0a52912275b8 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Getting quotas for project 44c9832086724954853fc474a2a92747. Resources: {'key_pairs'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:25:30.170014 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-8da3b6a1-15fd-45af-88be-0a52912275b8 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Getting quotas for user deb80cf02c84476182960a91d69b6da1 and project 44c9832086724954853fc474a2a92747. Resources: {'key_pairs'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:25:30.206108 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8da3b6a1-15fd-45af-88be-0a52912275b8 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.317197 Aug 26 18:25:30.207274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 135/279] 10.222.0.45 () {60 vars in 1159 bytes} [Fri Aug 26 18:25:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:25:30.363294 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ec26055a-b99a-48ae-b14a-8b24e8e46882 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:30.373172 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ec26055a-b99a-48ae-b14a-8b24e8e46882 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.238440 Aug 26 18:25:30.374062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 145/280] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:30 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:30.450105 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-77a0ef8f-a40c-4dad-a622-0549c389cb5c tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:30.450941 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-77a0ef8f-a40c-4dad-a622-0549c389cb5c tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:30.459826 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-77a0ef8f-a40c-4dad-a622-0549c389cb5c tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:30.460462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-77a0ef8f-a40c-4dad-a622-0549c389cb5c tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:30.461060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-77a0ef8f-a40c-4dad-a622-0549c389cb5c tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:30.461979 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-77a0ef8f-a40c-4dad-a622-0549c389cb5c tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:30.462700 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-77a0ef8f-a40c-4dad-a622-0549c389cb5c tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:30.463323 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-77a0ef8f-a40c-4dad-a622-0549c389cb5c tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:30.679398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-77a0ef8f-a40c-4dad-a622-0549c389cb5c tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:30.687886 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-77a0ef8f-a40c-4dad-a622-0549c389cb5c tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1314 microversion: 2.1 time: 0.241781 Aug 26 18:25:30.688470 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 136/281] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:30 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:31.395249 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-354bd3ff-9f0e-4a76-9590-93e0486cffc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:31.396626 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-354bd3ff-9f0e-4a76-9590-93e0486cffc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:31.403499 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-354bd3ff-9f0e-4a76-9590-93e0486cffc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:31.404034 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-354bd3ff-9f0e-4a76-9590-93e0486cffc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:31.404486 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-354bd3ff-9f0e-4a76-9590-93e0486cffc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:31.405190 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-354bd3ff-9f0e-4a76-9590-93e0486cffc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:31.405949 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-354bd3ff-9f0e-4a76-9590-93e0486cffc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:31.406546 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-354bd3ff-9f0e-4a76-9590-93e0486cffc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:31.550842 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-354bd3ff-9f0e-4a76-9590-93e0486cffc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:31.561710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-354bd3ff-9f0e-4a76-9590-93e0486cffc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.170494 Aug 26 18:25:31.564932 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 146/282] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:31 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:31.709734 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-dbb62e63-1139-47d5-8e8b-3b739dbbba96 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:31.711064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-dbb62e63-1139-47d5-8e8b-3b739dbbba96 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:31.717038 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dbb62e63-1139-47d5-8e8b-3b739dbbba96 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:31.717552 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dbb62e63-1139-47d5-8e8b-3b739dbbba96 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:31.718046 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dbb62e63-1139-47d5-8e8b-3b739dbbba96 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:31.718980 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dbb62e63-1139-47d5-8e8b-3b739dbbba96 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:31.719493 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dbb62e63-1139-47d5-8e8b-3b739dbbba96 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:31.720072 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dbb62e63-1139-47d5-8e8b-3b739dbbba96 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:31.959592 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-dbb62e63-1139-47d5-8e8b-3b739dbbba96 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:31.963238 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:31.968503 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-dbb62e63-1139-47d5-8e8b-3b739dbbba96 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1314 microversion: 2.1 time: 0.262815 Aug 26 18:25:31.969060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 137/283] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:31 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:32.599536 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-692ff828-371b-4c2d-8a9b-ea00e1bf01a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:32.601915 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-692ff828-371b-4c2d-8a9b-ea00e1bf01a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:32.608940 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-692ff828-371b-4c2d-8a9b-ea00e1bf01a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:32.609621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-692ff828-371b-4c2d-8a9b-ea00e1bf01a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:32.610051 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-692ff828-371b-4c2d-8a9b-ea00e1bf01a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:32.610843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-692ff828-371b-4c2d-8a9b-ea00e1bf01a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:32.611467 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-692ff828-371b-4c2d-8a9b-ea00e1bf01a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:32.611890 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-692ff828-371b-4c2d-8a9b-ea00e1bf01a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:32.727903 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-15f4c755-afac-4af5-8c64-8dc1756e1b94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:32.727903 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-15f4c755-afac-4af5-8c64-8dc1756e1b94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:32.740293 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-15f4c755-afac-4af5-8c64-8dc1756e1b94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:32.740808 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-15f4c755-afac-4af5-8c64-8dc1756e1b94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:32.741728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-15f4c755-afac-4af5-8c64-8dc1756e1b94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:32.746614 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-15f4c755-afac-4af5-8c64-8dc1756e1b94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:32.747125 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-15f4c755-afac-4af5-8c64-8dc1756e1b94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:32.750026 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-15f4c755-afac-4af5-8c64-8dc1756e1b94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:32.812030 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-15f4c755-afac-4af5-8c64-8dc1756e1b94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lazy-loading 'flavor' on Instance uuid 1ed32b7d-a792-49b2-84e7-962f4d537501 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:25:32.817577 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-692ff828-371b-4c2d-8a9b-ea00e1bf01a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:32.833752 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-692ff828-371b-4c2d-8a9b-ea00e1bf01a7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.252940 Aug 26 18:25:32.834714 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 147/284] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:32 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:32.905409 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:32.991092 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-394cae58-255d-42eb-b4c9-0d06e4118ba8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:32.991856 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-394cae58-255d-42eb-b4c9-0d06e4118ba8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:33.002668 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-394cae58-255d-42eb-b4c9-0d06e4118ba8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:33.005199 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-394cae58-255d-42eb-b4c9-0d06e4118ba8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:33.006742 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-394cae58-255d-42eb-b4c9-0d06e4118ba8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:33.009444 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-394cae58-255d-42eb-b4c9-0d06e4118ba8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:33.011971 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-394cae58-255d-42eb-b4c9-0d06e4118ba8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:33.012649 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-394cae58-255d-42eb-b4c9-0d06e4118ba8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:33.187781 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-15f4c755-afac-4af5-8c64-8dc1756e1b94 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "POST /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/action" status: 202 len: 0 microversion: 2.20 time: 0.465333 Aug 26 18:25:33.197481 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 138/285] 10.222.0.45 () {62 vars in 1319 bytes} [Fri Aug 26 18:25:32 2022] POST /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 26 18:25:33.205075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-895051d2-64ad-466c-8dc1-e331893930bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:33.205787 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-895051d2-64ad-466c-8dc1-e331893930bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:33.217449 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:33.217704 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-895051d2-64ad-466c-8dc1-e331893930bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:33.218198 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-895051d2-64ad-466c-8dc1-e331893930bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:33.218683 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-895051d2-64ad-466c-8dc1-e331893930bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:33.219441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-895051d2-64ad-466c-8dc1-e331893930bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:33.220147 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-895051d2-64ad-466c-8dc1-e331893930bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:33.221007 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-895051d2-64ad-466c-8dc1-e331893930bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:33.341551 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-394cae58-255d-42eb-b4c9-0d06e4118ba8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:33.348777 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-394cae58-255d-42eb-b4c9-0d06e4118ba8 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1314 microversion: 2.1 time: 0.363274 Aug 26 18:25:33.349751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 148/286] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:32 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:33.394568 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-895051d2-64ad-466c-8dc1-e331893930bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:33.404030 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-895051d2-64ad-466c-8dc1-e331893930bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:33.405559 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-895051d2-64ad-466c-8dc1-e331893930bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:33.406880 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-895051d2-64ad-466c-8dc1-e331893930bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.206746 Aug 26 18:25:33.419978 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 139/287] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:33 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:33.854500 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6668f684-2d31-46cd-9122-b9cbbd09bdbc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:33.855359 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6668f684-2d31-46cd-9122-b9cbbd09bdbc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:33.861971 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6668f684-2d31-46cd-9122-b9cbbd09bdbc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:33.862451 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6668f684-2d31-46cd-9122-b9cbbd09bdbc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:33.862880 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6668f684-2d31-46cd-9122-b9cbbd09bdbc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:33.863565 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6668f684-2d31-46cd-9122-b9cbbd09bdbc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:33.864008 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6668f684-2d31-46cd-9122-b9cbbd09bdbc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:33.864420 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6668f684-2d31-46cd-9122-b9cbbd09bdbc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:34.019502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6668f684-2d31-46cd-9122-b9cbbd09bdbc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:34.042544 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6668f684-2d31-46cd-9122-b9cbbd09bdbc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.191864 Aug 26 18:25:34.043117 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 149/288] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:33 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:34.118648 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1d5abc86-f542-4c2d-968a-035e26cbef2f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b124389-17a0-4320-bbb5-58f127bc7a70"}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:34.121498 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1d5abc86-f542-4c2d-968a-035e26cbef2f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:34.127683 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d5abc86-f542-4c2d-968a-035e26cbef2f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:34.128172 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d5abc86-f542-4c2d-968a-035e26cbef2f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:34.128606 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d5abc86-f542-4c2d-968a-035e26cbef2f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:34.129339 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d5abc86-f542-4c2d-968a-035e26cbef2f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:34.129823 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d5abc86-f542-4c2d-968a-035e26cbef2f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:34.130238 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d5abc86-f542-4c2d-968a-035e26cbef2f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:34.370476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bbb2b8f7-3454-4422-a633-6b92a579bc21 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:34.371095 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bbb2b8f7-3454-4422-a633-6b92a579bc21 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:34.377522 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbb2b8f7-3454-4422-a633-6b92a579bc21 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:34.378027 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbb2b8f7-3454-4422-a633-6b92a579bc21 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:34.378534 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbb2b8f7-3454-4422-a633-6b92a579bc21 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:34.379236 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbb2b8f7-3454-4422-a633-6b92a579bc21 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:34.379676 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbb2b8f7-3454-4422-a633-6b92a579bc21 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:34.380273 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbb2b8f7-3454-4422-a633-6b92a579bc21 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:34.629125 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bbb2b8f7-3454-4422-a633-6b92a579bc21 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:34.641504 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bbb2b8f7-3454-4422-a633-6b92a579bc21 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1314 microversion: 2.1 time: 0.275582 Aug 26 18:25:34.665735 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 150/289] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:34 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:34.670818 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1a67172a-a1b3-40d2-a31e-7d16b68fec88 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:34.671429 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1a67172a-a1b3-40d2-a31e-7d16b68fec88 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:34.686295 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a67172a-a1b3-40d2-a31e-7d16b68fec88 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:34.689359 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a67172a-a1b3-40d2-a31e-7d16b68fec88 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:34.689870 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a67172a-a1b3-40d2-a31e-7d16b68fec88 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:34.690664 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a67172a-a1b3-40d2-a31e-7d16b68fec88 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:34.693273 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a67172a-a1b3-40d2-a31e-7d16b68fec88 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:34.693737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a67172a-a1b3-40d2-a31e-7d16b68fec88 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:34.837978 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1a67172a-a1b3-40d2-a31e-7d16b68fec88 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:34.848153 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1a67172a-a1b3-40d2-a31e-7d16b68fec88 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:34.850565 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1a67172a-a1b3-40d2-a31e-7d16b68fec88 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:34.852278 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1a67172a-a1b3-40d2-a31e-7d16b68fec88 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.185227 Aug 26 18:25:34.853136 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 151/290] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:34 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:35.074526 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ea41e5d5-0f72-45db-87c8-28f51d0552c4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:35.075435 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ea41e5d5-0f72-45db-87c8-28f51d0552c4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:35.082897 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea41e5d5-0f72-45db-87c8-28f51d0552c4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:35.083377 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea41e5d5-0f72-45db-87c8-28f51d0552c4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:35.083994 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea41e5d5-0f72-45db-87c8-28f51d0552c4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:35.084906 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea41e5d5-0f72-45db-87c8-28f51d0552c4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:35.085815 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea41e5d5-0f72-45db-87c8-28f51d0552c4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:35.086519 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea41e5d5-0f72-45db-87c8-28f51d0552c4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:35.235814 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ea41e5d5-0f72-45db-87c8-28f51d0552c4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:35.238270 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:35.246842 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ea41e5d5-0f72-45db-87c8-28f51d0552c4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1501 microversion: 2.1 time: 0.176565 Aug 26 18:25:35.247570 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 152/291] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:35 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:35.267816 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-21ed0df6-4147-477e-a5dd-13e7c56b2754 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15534d32-9e5d-4b61-a779-ce799abe9257"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:35.270533 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-21ed0df6-4147-477e-a5dd-13e7c56b2754 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:35.276951 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21ed0df6-4147-477e-a5dd-13e7c56b2754 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:35.277577 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21ed0df6-4147-477e-a5dd-13e7c56b2754 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:35.278179 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21ed0df6-4147-477e-a5dd-13e7c56b2754 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:35.279183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21ed0df6-4147-477e-a5dd-13e7c56b2754 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:35.279659 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21ed0df6-4147-477e-a5dd-13e7c56b2754 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:35.280107 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21ed0df6-4147-477e-a5dd-13e7c56b2754 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:35.306219 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-21ed0df6-4147-477e-a5dd-13e7c56b2754 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] HTTP exception thrown: Cannot 'attach_volume' instance 6249cc1c-c171-41b8-81d5-2d73ed7735be while it is in vm_state rescued Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-21ed0df6-4147-477e-a5dd-13e7c56b2754 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Request method failure captured: Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: POST /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be/os-volume_attachments HTTP/1.1 Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 74 Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ-q3zm4iqYsaqe6bB_XUaX46zVzzw5UqiDi0-NWNM8uHB_C5he6uznHk9eGLXg2ymLBubpgUrHzXL84c_lo2S7oVUjU4Q0PoVOxgY1frPPZbjfxZpPuL-Bvosu5RLz3DtLT6Icwl-SAd9UlXmMJkuBN-9ExPAx31BGg6XtRADVIRq0 Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 1a8356be55fb4b19a95da8b77c6e2f9a Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1193523936 Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:25:35.307933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:25:35.309567 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1a8356be55fb4b19a95da8b77c6e2f9a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1a8356be55fb4b19a95da8b77c6e2f9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1a8356be55fb4b19a95da8b77c6e2f9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1a8356be55fb4b19a95da8b77c6e2f9a"}]}] Aug 26 18:25:35.309567 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1193523936 Aug 26 18:25:35.309567 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 1a8356be55fb4b19a95da8b77c6e2f9a Aug 26 18:25:35.309567 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1193523936 Aug 26 18:25:35.309567 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-ServerRescueNegativeTestJSON-1193523936-project Aug 26 18:25:35.309567 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:25:35.309567 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:25:35.309567 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: c78657cb0d4144cfaf0a7be1e3388ed0 Aug 26 18:25:35.309567 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1193523936-project Aug 26 18:25:35.309567 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Aug 26 18:25:35.309567 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {"volumeAttachment": {"volumeId": "15534d32-9e5d-4b61-a779-ce799abe9257"}} Aug 26 18:25:35.309567 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Cannot 'attach_volume' instance 6249cc1c-c171-41b8-81d5-2d73ed7735be while it is in vm_state rescued Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'server_id': '6249cc1c-c171-41b8-81d5-2d73ed7735be', 'body': {'volumeAttachment': {'volumeId': '15534d32-9e5d-4b61-a779-ce799abe9257'}}} Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6249cc1c-c171-41b8-81d5-2d73ed7735be in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:25:35.310523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6249cc1c-c171-41b8-81d5-2d73ed7735be while it is in vm_state rescued Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:25:35.311869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:25:35.313242 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:25:35.313242 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:25:35.313242 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6249cc1c-c171-41b8-81d5-2d73ed7735be while it is in vm_state rescued Aug 26 18:25:35.313242 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:25:35.313242 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-21ed0df6-4147-477e-a5dd-13e7c56b2754 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Returning 409 to user: Cannot 'attach_volume' instance 6249cc1c-c171-41b8-81d5-2d73ed7735be while it is in vm_state rescued {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:25:35.313242 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-21ed0df6-4147-477e-a5dd-13e7c56b2754 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "POST /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045773 Aug 26 18:25:35.313670 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 153/292] 10.222.0.45 () {60 vars in 1323 bytes} [Fri Aug 26 18:25:35 2022] POST /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 26 18:25:35.318114 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3d37b499-a5e7-431f-a0da-c4ebdee3bd15 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:35.318640 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3d37b499-a5e7-431f-a0da-c4ebdee3bd15 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:35.325227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d37b499-a5e7-431f-a0da-c4ebdee3bd15 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:35.325872 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d37b499-a5e7-431f-a0da-c4ebdee3bd15 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:35.326369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d37b499-a5e7-431f-a0da-c4ebdee3bd15 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:35.327088 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d37b499-a5e7-431f-a0da-c4ebdee3bd15 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:35.327592 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d37b499-a5e7-431f-a0da-c4ebdee3bd15 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:35.328197 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d37b499-a5e7-431f-a0da-c4ebdee3bd15 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:35.351118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1d5abc86-f542-4c2d-968a-035e26cbef2f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "POST /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.236634 Aug 26 18:25:35.351740 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 140/293] 10.222.0.45 () {60 vars in 1323 bytes} [Fri Aug 26 18:25:34 2022] POST /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/os-volume_attachments => generated 194 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:25:35.407080 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3d37b499-a5e7-431f-a0da-c4ebdee3bd15 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "POST /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be/action" status: 202 len: 0 microversion: 2.1 time: 0.092309 Aug 26 18:25:35.407694 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 154/294] 10.222.0.45 () {60 vars in 1278 bytes} [Fri Aug 26 18:25:35 2022] POST /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:25:35.418561 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-82c5ae9d-f337-4b8e-9558-9a8c6674b7b2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:35.419619 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-82c5ae9d-f337-4b8e-9558-9a8c6674b7b2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:35.426233 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-82c5ae9d-f337-4b8e-9558-9a8c6674b7b2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:35.426734 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-82c5ae9d-f337-4b8e-9558-9a8c6674b7b2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:35.427163 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-82c5ae9d-f337-4b8e-9558-9a8c6674b7b2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:35.427867 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-82c5ae9d-f337-4b8e-9558-9a8c6674b7b2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:35.428310 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-82c5ae9d-f337-4b8e-9558-9a8c6674b7b2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:35.428742 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-82c5ae9d-f337-4b8e-9558-9a8c6674b7b2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:35.572748 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-82c5ae9d-f337-4b8e-9558-9a8c6674b7b2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:35.580687 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-82c5ae9d-f337-4b8e-9558-9a8c6674b7b2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1509 microversion: 2.1 time: 0.168169 Aug 26 18:25:35.581315 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 141/295] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:35 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:35.663514 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-38b4fef4-5167-4b8c-b435-25d952aab92a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:35.664201 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-38b4fef4-5167-4b8c-b435-25d952aab92a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:35.671278 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38b4fef4-5167-4b8c-b435-25d952aab92a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:35.671764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38b4fef4-5167-4b8c-b435-25d952aab92a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:35.672183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38b4fef4-5167-4b8c-b435-25d952aab92a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:35.672906 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38b4fef4-5167-4b8c-b435-25d952aab92a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:35.673365 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38b4fef4-5167-4b8c-b435-25d952aab92a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:35.673778 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38b4fef4-5167-4b8c-b435-25d952aab92a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:35.819904 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-38b4fef4-5167-4b8c-b435-25d952aab92a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:35.828144 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-38b4fef4-5167-4b8c-b435-25d952aab92a tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1314 microversion: 2.1 time: 0.168859 Aug 26 18:25:35.828747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 155/296] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:35 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:35.877047 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-cf408428-d78e-4380-b298-3084058f78ca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:35.877800 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-cf408428-d78e-4380-b298-3084058f78ca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:35.884883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cf408428-d78e-4380-b298-3084058f78ca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:35.885456 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cf408428-d78e-4380-b298-3084058f78ca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:35.886005 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cf408428-d78e-4380-b298-3084058f78ca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:35.886781 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cf408428-d78e-4380-b298-3084058f78ca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:35.887270 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cf408428-d78e-4380-b298-3084058f78ca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:35.887678 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cf408428-d78e-4380-b298-3084058f78ca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:36.020991 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-cf408428-d78e-4380-b298-3084058f78ca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:36.029516 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-cf408428-d78e-4380-b298-3084058f78ca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:36.030963 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-cf408428-d78e-4380-b298-3084058f78ca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:36.032133 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-cf408428-d78e-4380-b298-3084058f78ca tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.159351 Aug 26 18:25:36.032652 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 142/297] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:35 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:36.602717 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b7ce24da-a335-4397-9b1e-32cc52576ac7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:36.603327 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b7ce24da-a335-4397-9b1e-32cc52576ac7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:36.610178 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7ce24da-a335-4397-9b1e-32cc52576ac7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:36.610661 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7ce24da-a335-4397-9b1e-32cc52576ac7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:36.611099 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7ce24da-a335-4397-9b1e-32cc52576ac7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:36.611786 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7ce24da-a335-4397-9b1e-32cc52576ac7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:36.612233 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7ce24da-a335-4397-9b1e-32cc52576ac7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:36.612653 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7ce24da-a335-4397-9b1e-32cc52576ac7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:36.751845 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b7ce24da-a335-4397-9b1e-32cc52576ac7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:36.759952 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b7ce24da-a335-4397-9b1e-32cc52576ac7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1509 microversion: 2.1 time: 0.161184 Aug 26 18:25:36.760502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 156/298] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:36 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:36.849525 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0ec69517-7968-4309-a625-5ce47ff77fe0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:36.850097 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-0ec69517-7968-4309-a625-5ce47ff77fe0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:36.857196 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0ec69517-7968-4309-a625-5ce47ff77fe0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:36.857683 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0ec69517-7968-4309-a625-5ce47ff77fe0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:36.858110 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0ec69517-7968-4309-a625-5ce47ff77fe0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:36.858809 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0ec69517-7968-4309-a625-5ce47ff77fe0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:36.859256 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0ec69517-7968-4309-a625-5ce47ff77fe0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:36.859674 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0ec69517-7968-4309-a625-5ce47ff77fe0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:36.991413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0ec69517-7968-4309-a625-5ce47ff77fe0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:36.999577 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-0ec69517-7968-4309-a625-5ce47ff77fe0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1314 microversion: 2.1 time: 0.154235 Aug 26 18:25:37.000303 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 143/299] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:36 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:37.056318 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a38d8191-3f68-4863-b0f4-3a886a05c730 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:37.056972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a38d8191-3f68-4863-b0f4-3a886a05c730 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:37.059002 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=96 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:37.064967 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a38d8191-3f68-4863-b0f4-3a886a05c730 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:37.065443 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a38d8191-3f68-4863-b0f4-3a886a05c730 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:37.065876 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a38d8191-3f68-4863-b0f4-3a886a05c730 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:37.066566 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a38d8191-3f68-4863-b0f4-3a886a05c730 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:37.067005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a38d8191-3f68-4863-b0f4-3a886a05c730 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:37.067433 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a38d8191-3f68-4863-b0f4-3a886a05c730 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:37.199590 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a38d8191-3f68-4863-b0f4-3a886a05c730 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:37.208095 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a38d8191-3f68-4863-b0f4-3a886a05c730 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:37.209557 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a38d8191-3f68-4863-b0f4-3a886a05c730 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:37.210695 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a38d8191-3f68-4863-b0f4-3a886a05c730 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.158553 Aug 26 18:25:37.211232 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 157/300] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:37 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:37.781880 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-31d3931a-5397-4db7-a96a-23e0eaddfe4c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:37.782423 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-31d3931a-5397-4db7-a96a-23e0eaddfe4c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:37.789442 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-31d3931a-5397-4db7-a96a-23e0eaddfe4c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:37.789954 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-31d3931a-5397-4db7-a96a-23e0eaddfe4c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:37.790404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-31d3931a-5397-4db7-a96a-23e0eaddfe4c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:37.791135 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-31d3931a-5397-4db7-a96a-23e0eaddfe4c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:37.791609 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-31d3931a-5397-4db7-a96a-23e0eaddfe4c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:37.792046 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-31d3931a-5397-4db7-a96a-23e0eaddfe4c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:37.927200 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-31d3931a-5397-4db7-a96a-23e0eaddfe4c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:37.939172 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-31d3931a-5397-4db7-a96a-23e0eaddfe4c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1509 microversion: 2.1 time: 0.161489 Aug 26 18:25:37.939779 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 144/301] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:37 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:38.021529 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-92befa94-e2a1-419b-afb1-355afceaa636 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:38.022198 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-92befa94-e2a1-419b-afb1-355afceaa636 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:38.028933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92befa94-e2a1-419b-afb1-355afceaa636 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:38.029422 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92befa94-e2a1-419b-afb1-355afceaa636 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:38.029858 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92befa94-e2a1-419b-afb1-355afceaa636 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:38.030547 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92befa94-e2a1-419b-afb1-355afceaa636 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:38.030986 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92befa94-e2a1-419b-afb1-355afceaa636 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:38.031405 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92befa94-e2a1-419b-afb1-355afceaa636 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:38.234098 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-a1108c81-5a1a-469e-8a0f-3571466fba62 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:38.234699 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-a1108c81-5a1a-469e-8a0f-3571466fba62 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:38.242339 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a1108c81-5a1a-469e-8a0f-3571466fba62 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:38.242826 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a1108c81-5a1a-469e-8a0f-3571466fba62 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:38.243249 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a1108c81-5a1a-469e-8a0f-3571466fba62 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:38.243955 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a1108c81-5a1a-469e-8a0f-3571466fba62 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:38.244611 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a1108c81-5a1a-469e-8a0f-3571466fba62 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:38.244816 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a1108c81-5a1a-469e-8a0f-3571466fba62 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:38.383026 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a1108c81-5a1a-469e-8a0f-3571466fba62 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:38.392925 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a1108c81-5a1a-469e-8a0f-3571466fba62 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:38.394342 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a1108c81-5a1a-469e-8a0f-3571466fba62 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:38.395504 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-a1108c81-5a1a-469e-8a0f-3571466fba62 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.165556 Aug 26 18:25:38.396093 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 145/302] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:38 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:38.416537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-92befa94-e2a1-419b-afb1-355afceaa636 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:38.424517 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-92befa94-e2a1-419b-afb1-355afceaa636 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1314 microversion: 2.1 time: 0.407053 Aug 26 18:25:38.425119 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 158/303] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:38 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:38.960995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c1510105-2888-445e-b158-a22776958429 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:38.961934 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c1510105-2888-445e-b158-a22776958429 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:38.968650 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1510105-2888-445e-b158-a22776958429 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:38.969269 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1510105-2888-445e-b158-a22776958429 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:38.969767 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1510105-2888-445e-b158-a22776958429 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:38.970528 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1510105-2888-445e-b158-a22776958429 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:38.971046 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1510105-2888-445e-b158-a22776958429 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:38.971550 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1510105-2888-445e-b158-a22776958429 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:39.121914 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c1510105-2888-445e-b158-a22776958429 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:39.129595 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c1510105-2888-445e-b158-a22776958429 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1509 microversion: 2.1 time: 0.172706 Aug 26 18:25:39.130125 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 146/304] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:38 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:39.419803 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ccf9355b-1068-4e41-b3e1-6a799735f305 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:39.420379 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ccf9355b-1068-4e41-b3e1-6a799735f305 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:39.427578 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccf9355b-1068-4e41-b3e1-6a799735f305 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:39.428059 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccf9355b-1068-4e41-b3e1-6a799735f305 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:39.428488 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccf9355b-1068-4e41-b3e1-6a799735f305 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:39.429223 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccf9355b-1068-4e41-b3e1-6a799735f305 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:39.429669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccf9355b-1068-4e41-b3e1-6a799735f305 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:39.430085 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccf9355b-1068-4e41-b3e1-6a799735f305 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:39.445989 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-547828aa-3a04-42d2-9ac0-351833e55179 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:39.446585 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-547828aa-3a04-42d2-9ac0-351833e55179 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:39.454958 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-547828aa-3a04-42d2-9ac0-351833e55179 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:39.455437 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-547828aa-3a04-42d2-9ac0-351833e55179 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:39.455841 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-547828aa-3a04-42d2-9ac0-351833e55179 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:39.456536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-547828aa-3a04-42d2-9ac0-351833e55179 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:39.457015 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-547828aa-3a04-42d2-9ac0-351833e55179 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:39.457439 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-547828aa-3a04-42d2-9ac0-351833e55179 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:39.568012 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ccf9355b-1068-4e41-b3e1-6a799735f305 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:39.576892 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ccf9355b-1068-4e41-b3e1-6a799735f305 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:39.578346 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ccf9355b-1068-4e41-b3e1-6a799735f305 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:39.579510 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ccf9355b-1068-4e41-b3e1-6a799735f305 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.163925 Aug 26 18:25:39.580057 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 159/305] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:39 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:39.599979 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-547828aa-3a04-42d2-9ac0-351833e55179 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:39.607506 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-547828aa-3a04-42d2-9ac0-351833e55179 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1314 microversion: 2.1 time: 0.165866 Aug 26 18:25:39.608059 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 147/306] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:39 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:40.151046 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f5a08756-6400-430d-984c-08983e800282 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:40.151663 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f5a08756-6400-430d-984c-08983e800282 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:40.157952 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5a08756-6400-430d-984c-08983e800282 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:40.158433 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5a08756-6400-430d-984c-08983e800282 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:40.158874 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5a08756-6400-430d-984c-08983e800282 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:40.159561 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5a08756-6400-430d-984c-08983e800282 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:40.160007 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5a08756-6400-430d-984c-08983e800282 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:40.160427 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5a08756-6400-430d-984c-08983e800282 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:40.299762 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f5a08756-6400-430d-984c-08983e800282 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:40.309220 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f5a08756-6400-430d-984c-08983e800282 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1509 microversion: 2.1 time: 0.162121 Aug 26 18:25:40.310546 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 160/307] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:40 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:40.360970 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-2820a5a9-0e02-4587-a285-d12b40843e77 req-58d5af2b-0c2e-4183-abfa-90e84fb5070a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a", "name": "network-vif-plugged", "status": "completed", "tag": "13682441-428e-4d86-b204-28aed368fd97"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:40.366634 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=10 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:40.372923 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2820a5a9-0e02-4587-a285-d12b40843e77 req-58d5af2b-0c2e-4183-abfa-90e84fb5070a service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:40.373404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2820a5a9-0e02-4587-a285-d12b40843e77 req-58d5af2b-0c2e-4183-abfa-90e84fb5070a service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:40.373877 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2820a5a9-0e02-4587-a285-d12b40843e77 req-58d5af2b-0c2e-4183-abfa-90e84fb5070a service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:40.386276 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-2820a5a9-0e02-4587-a285-d12b40843e77 req-58d5af2b-0c2e-4183-abfa-90e84fb5070a service nova] Creating event network-vif-plugged:13682441-428e-4d86-b204-28aed368fd97 for instance ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a on hv-cinder-85199 Aug 26 18:25:40.391215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-2820a5a9-0e02-4587-a285-d12b40843e77 req-58d5af2b-0c2e-4183-abfa-90e84fb5070a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033978 Aug 26 18:25:40.392294 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 148/308] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:25:40.602216 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8d556c25-8e75-40f5-990d-06ba1b62146c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:40.602768 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8d556c25-8e75-40f5-990d-06ba1b62146c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:40.609928 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d556c25-8e75-40f5-990d-06ba1b62146c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:40.610377 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d556c25-8e75-40f5-990d-06ba1b62146c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:40.610831 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d556c25-8e75-40f5-990d-06ba1b62146c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:40.611524 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d556c25-8e75-40f5-990d-06ba1b62146c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:40.611956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d556c25-8e75-40f5-990d-06ba1b62146c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:40.612494 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d556c25-8e75-40f5-990d-06ba1b62146c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:40.628157 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8902bc41-91ff-49da-b326-9a9343095c74 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:40.628967 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8902bc41-91ff-49da-b326-9a9343095c74 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:40.635368 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8902bc41-91ff-49da-b326-9a9343095c74 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:40.635936 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8902bc41-91ff-49da-b326-9a9343095c74 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:40.636480 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8902bc41-91ff-49da-b326-9a9343095c74 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:40.637196 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8902bc41-91ff-49da-b326-9a9343095c74 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:40.637706 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8902bc41-91ff-49da-b326-9a9343095c74 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:40.638159 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8902bc41-91ff-49da-b326-9a9343095c74 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:40.773999 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8d556c25-8e75-40f5-990d-06ba1b62146c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:40.782919 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8d556c25-8e75-40f5-990d-06ba1b62146c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:40.784812 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8d556c25-8e75-40f5-990d-06ba1b62146c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:40.786621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8d556c25-8e75-40f5-990d-06ba1b62146c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.188442 Aug 26 18:25:40.787538 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 161/309] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:40 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:40.810679 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8902bc41-91ff-49da-b326-9a9343095c74 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:40.818648 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8902bc41-91ff-49da-b326-9a9343095c74 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1314 microversion: 2.1 time: 0.194830 Aug 26 18:25:40.819243 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 149/310] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:40 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:41.330515 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-58f7b7f6-8618-4fc3-88f3-0f27ee1eeabc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:41.331142 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-58f7b7f6-8618-4fc3-88f3-0f27ee1eeabc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:41.337811 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58f7b7f6-8618-4fc3-88f3-0f27ee1eeabc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:41.338289 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58f7b7f6-8618-4fc3-88f3-0f27ee1eeabc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:41.338711 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58f7b7f6-8618-4fc3-88f3-0f27ee1eeabc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:41.339428 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58f7b7f6-8618-4fc3-88f3-0f27ee1eeabc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:41.339870 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58f7b7f6-8618-4fc3-88f3-0f27ee1eeabc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:41.340306 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58f7b7f6-8618-4fc3-88f3-0f27ee1eeabc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:41.479674 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-58f7b7f6-8618-4fc3-88f3-0f27ee1eeabc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:41.488262 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-58f7b7f6-8618-4fc3-88f3-0f27ee1eeabc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1509 microversion: 2.1 time: 0.162275 Aug 26 18:25:41.488976 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 162/311] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:41 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:41.811284 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-5faa6a21-3dc2-46a1-ab32-804ef2401bde tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:41.812596 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-5faa6a21-3dc2-46a1-ab32-804ef2401bde tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:41.819397 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5faa6a21-3dc2-46a1-ab32-804ef2401bde tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:41.819861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5faa6a21-3dc2-46a1-ab32-804ef2401bde tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:41.820258 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5faa6a21-3dc2-46a1-ab32-804ef2401bde tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:41.820970 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5faa6a21-3dc2-46a1-ab32-804ef2401bde tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:41.821567 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5faa6a21-3dc2-46a1-ab32-804ef2401bde tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:41.822175 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5faa6a21-3dc2-46a1-ab32-804ef2401bde tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:41.842443 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7507b253-6341-4789-8b03-9ad4d92203b3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:41.843067 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7507b253-6341-4789-8b03-9ad4d92203b3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:41.851546 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7507b253-6341-4789-8b03-9ad4d92203b3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:41.852011 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7507b253-6341-4789-8b03-9ad4d92203b3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:41.852439 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7507b253-6341-4789-8b03-9ad4d92203b3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:41.856505 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7507b253-6341-4789-8b03-9ad4d92203b3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:41.857129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7507b253-6341-4789-8b03-9ad4d92203b3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:41.860609 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7507b253-6341-4789-8b03-9ad4d92203b3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:41.993003 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5faa6a21-3dc2-46a1-ab32-804ef2401bde tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:42.001365 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5faa6a21-3dc2-46a1-ab32-804ef2401bde tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:42.002799 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5faa6a21-3dc2-46a1-ab32-804ef2401bde tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:42.003966 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-5faa6a21-3dc2-46a1-ab32-804ef2401bde tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.196741 Aug 26 18:25:42.004519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 150/312] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:41 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:42.008956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7507b253-6341-4789-8b03-9ad4d92203b3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:42.017478 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7507b253-6341-4789-8b03-9ad4d92203b3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1314 microversion: 2.1 time: 0.179131 Aug 26 18:25:42.018029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 163/313] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:41 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:42.510453 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-07ec45ee-55d0-4a11-8787-4d6a680aa691 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:42.510822 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-07ec45ee-55d0-4a11-8787-4d6a680aa691 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:42.523543 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-07ec45ee-55d0-4a11-8787-4d6a680aa691 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:42.524517 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-07ec45ee-55d0-4a11-8787-4d6a680aa691 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:42.524794 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-07ec45ee-55d0-4a11-8787-4d6a680aa691 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:42.525519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-07ec45ee-55d0-4a11-8787-4d6a680aa691 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:42.525976 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-07ec45ee-55d0-4a11-8787-4d6a680aa691 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:42.526402 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-07ec45ee-55d0-4a11-8787-4d6a680aa691 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:42.683891 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-07ec45ee-55d0-4a11-8787-4d6a680aa691 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:42.687600 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:42.693421 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-07ec45ee-55d0-4a11-8787-4d6a680aa691 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1515 microversion: 2.1 time: 0.187209 Aug 26 18:25:42.693995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 151/314] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:42 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:43.027436 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5204f20e-f268-4802-ac81-85b1e1967869 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:43.028037 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5204f20e-f268-4802-ac81-85b1e1967869 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:43.038257 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5204f20e-f268-4802-ac81-85b1e1967869 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:43.039028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5204f20e-f268-4802-ac81-85b1e1967869 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:43.039628 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5204f20e-f268-4802-ac81-85b1e1967869 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:43.040648 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5204f20e-f268-4802-ac81-85b1e1967869 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:43.041427 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5204f20e-f268-4802-ac81-85b1e1967869 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:43.042171 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5204f20e-f268-4802-ac81-85b1e1967869 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:43.042456 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-dd097078-7671-4e2f-bf29-2a4452d71fd0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:43.043274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-dd097078-7671-4e2f-bf29-2a4452d71fd0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:43.061720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dd097078-7671-4e2f-bf29-2a4452d71fd0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:43.065565 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dd097078-7671-4e2f-bf29-2a4452d71fd0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:43.066125 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dd097078-7671-4e2f-bf29-2a4452d71fd0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:43.066983 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dd097078-7671-4e2f-bf29-2a4452d71fd0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:43.067551 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dd097078-7671-4e2f-bf29-2a4452d71fd0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:43.069644 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dd097078-7671-4e2f-bf29-2a4452d71fd0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:43.190380 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5204f20e-f268-4802-ac81-85b1e1967869 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:43.198506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5204f20e-f268-4802-ac81-85b1e1967869 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:43.200413 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5204f20e-f268-4802-ac81-85b1e1967869 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:43.201625 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5204f20e-f268-4802-ac81-85b1e1967869 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.178129 Aug 26 18:25:43.202283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 164/315] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:43 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:43.229926 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-dd097078-7671-4e2f-bf29-2a4452d71fd0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:43.237740 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-dd097078-7671-4e2f-bf29-2a4452d71fd0 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1498 microversion: 2.1 time: 0.202181 Aug 26 18:25:43.238294 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 152/316] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:43 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1498 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:43.887793 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-206c9d43-dfef-4255-8876-0905f11cd553 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:43.888303 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-206c9d43-dfef-4255-8876-0905f11cd553 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:43.894960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-206c9d43-dfef-4255-8876-0905f11cd553 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:43.895447 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-206c9d43-dfef-4255-8876-0905f11cd553 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:43.895880 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-206c9d43-dfef-4255-8876-0905f11cd553 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:43.896599 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-206c9d43-dfef-4255-8876-0905f11cd553 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:43.897154 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-206c9d43-dfef-4255-8876-0905f11cd553 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:43.897576 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-206c9d43-dfef-4255-8876-0905f11cd553 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:43.923148 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-206c9d43-dfef-4255-8876-0905f11cd553 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:25:44.014586 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-206c9d43-dfef-4255-8876-0905f11cd553 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 204 len: 0 microversion: 2.1 time: 0.130494 Aug 26 18:25:44.015092 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 165/317] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:25:43 2022] DELETE /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:25:44.023997 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d60a6394-01ef-4561-811c-57c7de8f42de tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:44.024577 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-d60a6394-01ef-4561-811c-57c7de8f42de tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:44.030567 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d60a6394-01ef-4561-811c-57c7de8f42de tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:44.031038 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d60a6394-01ef-4561-811c-57c7de8f42de tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:44.031461 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d60a6394-01ef-4561-811c-57c7de8f42de tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:44.032242 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d60a6394-01ef-4561-811c-57c7de8f42de tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:44.032798 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d60a6394-01ef-4561-811c-57c7de8f42de tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:44.033215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d60a6394-01ef-4561-811c-57c7de8f42de tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:44.165049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d60a6394-01ef-4561-811c-57c7de8f42de tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:44.173283 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-d60a6394-01ef-4561-811c-57c7de8f42de tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1504 microversion: 2.1 time: 0.153214 Aug 26 18:25:44.173833 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 153/318] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:44 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:44.179146 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-169dcc4b-9b94-45ef-ba44-f113fb1e18be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Action: 'create', calling method: .version_select at 0x7fc74432b040>, body: {"keypair": {"name": "tempest-keypair-1417452474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBCL/wj8ryG/61j0Jhy0fcwJ+bk+6DeD6eEq9BOD1g8Mbvm99Egzi8jtIG1IpPSyW0M+kZvYudMWQaCzVPg38tdFCI9mIJqrH+eE8XW7ZJvdykSZXvLp0/84uoj2R/bqA=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:44.200064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-169dcc4b-9b94-45ef-ba44-f113fb1e18be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Getting quotas for project 1a8356be55fb4b19a95da8b77c6e2f9a. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:25:44.205792 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-169dcc4b-9b94-45ef-ba44-f113fb1e18be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Getting quotas for user c78657cb0d4144cfaf0a7be1e3388ed0 and project 1a8356be55fb4b19a95da8b77c6e2f9a. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:25:44.230268 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c97ef598-3ade-443c-b835-b51207f64f43 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:44.230910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c97ef598-3ade-443c-b835-b51207f64f43 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:44.238504 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c97ef598-3ade-443c-b835-b51207f64f43 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:44.239268 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c97ef598-3ade-443c-b835-b51207f64f43 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:44.239739 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c97ef598-3ade-443c-b835-b51207f64f43 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:44.240753 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c97ef598-3ade-443c-b835-b51207f64f43 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:44.241483 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c97ef598-3ade-443c-b835-b51207f64f43 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:44.242297 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c97ef598-3ade-443c-b835-b51207f64f43 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:44.249662 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-169dcc4b-9b94-45ef-ba44-f113fb1e18be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074566 Aug 26 18:25:44.250500 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 166/319] 10.222.0.45 () {60 vars in 1159 bytes} [Fri Aug 26 18:25:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:25:44.443027 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c97ef598-3ade-443c-b835-b51207f64f43 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:44.451392 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c97ef598-3ade-443c-b835-b51207f64f43 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:44.452883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c97ef598-3ade-443c-b835-b51207f64f43 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:44.454052 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c97ef598-3ade-443c-b835-b51207f64f43 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.232963 Aug 26 18:25:44.454783 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 154/320] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:44 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:25:45.197064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5b481a7d-ddd0-48ed-a474-d753235462d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:45.197881 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5b481a7d-ddd0-48ed-a474-d753235462d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:45.204773 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b481a7d-ddd0-48ed-a474-d753235462d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:45.205732 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b481a7d-ddd0-48ed-a474-d753235462d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:45.206163 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b481a7d-ddd0-48ed-a474-d753235462d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:45.206849 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b481a7d-ddd0-48ed-a474-d753235462d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:45.207288 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b481a7d-ddd0-48ed-a474-d753235462d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:45.207703 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b481a7d-ddd0-48ed-a474-d753235462d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:45.348342 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5b481a7d-ddd0-48ed-a474-d753235462d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:45.356602 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5b481a7d-ddd0-48ed-a474-d753235462d3 tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1504 microversion: 2.1 time: 0.163926 Aug 26 18:25:45.357307 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 167/321] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:45 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:45.478085 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7f10a76e-d7c0-42c3-953c-a2e602db0ddd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:45.478944 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-7f10a76e-d7c0-42c3-953c-a2e602db0ddd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:45.486603 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7f10a76e-d7c0-42c3-953c-a2e602db0ddd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:45.487099 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7f10a76e-d7c0-42c3-953c-a2e602db0ddd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:45.487522 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7f10a76e-d7c0-42c3-953c-a2e602db0ddd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:45.488604 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7f10a76e-d7c0-42c3-953c-a2e602db0ddd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:45.489105 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7f10a76e-d7c0-42c3-953c-a2e602db0ddd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:45.489513 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7f10a76e-d7c0-42c3-953c-a2e602db0ddd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:45.709237 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-7f10a76e-d7c0-42c3-953c-a2e602db0ddd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:45.724407 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-7f10a76e-d7c0-42c3-953c-a2e602db0ddd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:45.725964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-7f10a76e-d7c0-42c3-953c-a2e602db0ddd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:45.727187 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-7f10a76e-d7c0-42c3-953c-a2e602db0ddd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.253065 Aug 26 18:25:45.727762 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 155/322] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:45 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:45.960306 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1165630113", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a326cba7-5031-4ab2-a472-9420e131afd8"}], "security_groups": [{"name": "tempest-securitygroup--1767465015"}], "key_name": "tempest-keypair-1417452474", "user_data": "}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:46.067897 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] validate_networks() for [('a326cba7-5031-4ab2-a472-9420e131afd8', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:25:46.378990 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e27f3631-bd05-4630-b09a-83c7ebefccdf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:46.379705 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e27f3631-bd05-4630-b09a-83c7ebefccdf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:46.387157 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e27f3631-bd05-4630-b09a-83c7ebefccdf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:46.388956 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e27f3631-bd05-4630-b09a-83c7ebefccdf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:46.389686 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e27f3631-bd05-4630-b09a-83c7ebefccdf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:46.392390 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e27f3631-bd05-4630-b09a-83c7ebefccdf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:46.396561 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e27f3631-bd05-4630-b09a-83c7ebefccdf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:46.397137 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e27f3631-bd05-4630-b09a-83c7ebefccdf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:46.501056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:25:46.502046 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:25:46.502735 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:25:46.503337 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:25:46.503937 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:25:46.514545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:46.515338 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:46.515831 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:46.517353 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:46.517900 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:46.518563 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:46.525911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:46.535166 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e27f3631-bd05-4630-b09a-83c7ebefccdf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:46.540238 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Getting quotas for project 1a8356be55fb4b19a95da8b77c6e2f9a. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:25:46.545039 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e27f3631-bd05-4630-b09a-83c7ebefccdf tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1504 microversion: 2.1 time: 0.170369 Aug 26 18:25:46.545200 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Getting quotas for user c78657cb0d4144cfaf0a7be1e3388ed0 and project 1a8356be55fb4b19a95da8b77c6e2f9a. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:25:46.545872 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 156/323] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:46 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:46.556118 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:25:46.558444 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:25:46.606842 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a770c59e-0cbc-49a2-9c38-57ba935df0f6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.652141 Aug 26 18:25:46.608801 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 168/324] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:25:45 2022] POST /compute/v2.1/servers => generated 409 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 18:25:46.618555 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-af0fcf95-c341-4678-9c3b-eaa278b13a47 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:46.619159 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-af0fcf95-c341-4678-9c3b-eaa278b13a47 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:46.682921 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-af0fcf95-c341-4678-9c3b-eaa278b13a47 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:46.704285 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-af0fcf95-c341-4678-9c3b-eaa278b13a47 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1246 microversion: 2.1 time: 0.087662 Aug 26 18:25:46.709580 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 157/325] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:46 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:46.752339 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9e2fb49b-4c58-4319-8ae2-e0db038a9ca3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:46.753062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9e2fb49b-4c58-4319-8ae2-e0db038a9ca3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:46.766554 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e2fb49b-4c58-4319-8ae2-e0db038a9ca3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:46.766664 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e2fb49b-4c58-4319-8ae2-e0db038a9ca3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:46.769987 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e2fb49b-4c58-4319-8ae2-e0db038a9ca3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:46.770786 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e2fb49b-4c58-4319-8ae2-e0db038a9ca3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:46.772763 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e2fb49b-4c58-4319-8ae2-e0db038a9ca3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:46.773207 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e2fb49b-4c58-4319-8ae2-e0db038a9ca3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:46.987678 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9e2fb49b-4c58-4319-8ae2-e0db038a9ca3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:46.997647 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9e2fb49b-4c58-4319-8ae2-e0db038a9ca3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:46.999158 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9e2fb49b-4c58-4319-8ae2-e0db038a9ca3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:47.000325 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9e2fb49b-4c58-4319-8ae2-e0db038a9ca3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.253411 Aug 26 18:25:47.001887 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 169/326] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:46 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:47.225793 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-ab903a9d-0448-4183-a8c5-eae39c6713eb req-498051f0-0a95-4442-85e2-961bc8e4ef86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a", "name": "network-vif-deleted", "tag": "13682441-428e-4d86-b204-28aed368fd97"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:47.236746 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ab903a9d-0448-4183-a8c5-eae39c6713eb req-498051f0-0a95-4442-85e2-961bc8e4ef86 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:47.237438 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ab903a9d-0448-4183-a8c5-eae39c6713eb req-498051f0-0a95-4442-85e2-961bc8e4ef86 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:47.237884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ab903a9d-0448-4183-a8c5-eae39c6713eb req-498051f0-0a95-4442-85e2-961bc8e4ef86 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:47.251476 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-ab903a9d-0448-4183-a8c5-eae39c6713eb req-498051f0-0a95-4442-85e2-961bc8e4ef86 service nova] Creating event network-vif-deleted:13682441-428e-4d86-b204-28aed368fd97 for instance ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a on hv-cinder-85199 Aug 26 18:25:47.256637 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-ab903a9d-0448-4183-a8c5-eae39c6713eb req-498051f0-0a95-4442-85e2-961bc8e4ef86 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035574 Aug 26 18:25:47.257350 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 158/327] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:25:47.271637 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-64796b6d-5bad-458f-bb46-2c8247f027eb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:47.278296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64796b6d-5bad-458f-bb46-2c8247f027eb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:47.278778 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64796b6d-5bad-458f-bb46-2c8247f027eb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:47.279338 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64796b6d-5bad-458f-bb46-2c8247f027eb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:47.339987 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-64796b6d-5bad-458f-bb46-2c8247f027eb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Going to try to stop instance {{(pid=120539) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 18:25:47.393694 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-64796b6d-5bad-458f-bb46-2c8247f027eb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "POST /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/action" status: 202 len: 0 microversion: 2.1 time: 0.125569 Aug 26 18:25:47.394542 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 170/328] 10.222.0.45 () {60 vars in 1278 bytes} [Fri Aug 26 18:25:47 2022] POST /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:25:47.407336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1195f7e3-6f8f-4fb5-8847-ba2d205420bc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:47.408798 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1195f7e3-6f8f-4fb5-8847-ba2d205420bc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:47.420415 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1195f7e3-6f8f-4fb5-8847-ba2d205420bc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:47.421286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1195f7e3-6f8f-4fb5-8847-ba2d205420bc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:47.422005 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1195f7e3-6f8f-4fb5-8847-ba2d205420bc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:47.423187 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1195f7e3-6f8f-4fb5-8847-ba2d205420bc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:47.423988 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1195f7e3-6f8f-4fb5-8847-ba2d205420bc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:47.424728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1195f7e3-6f8f-4fb5-8847-ba2d205420bc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:47.569002 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c3b3f788-4aa1-4fce-8085-e2648cfb90cd tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:47.575530 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1195f7e3-6f8f-4fb5-8847-ba2d205420bc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:47.576425 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c3b3f788-4aa1-4fce-8085-e2648cfb90cd tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:47.584374 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3b3f788-4aa1-4fce-8085-e2648cfb90cd tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:47.586449 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3b3f788-4aa1-4fce-8085-e2648cfb90cd tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:47.586579 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1195f7e3-6f8f-4fb5-8847-ba2d205420bc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.186473 Aug 26 18:25:47.587162 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 159/329] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:47 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:47.587380 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3b3f788-4aa1-4fce-8085-e2648cfb90cd tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:47.588217 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3b3f788-4aa1-4fce-8085-e2648cfb90cd tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:47.588940 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3b3f788-4aa1-4fce-8085-e2648cfb90cd tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:47.589356 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3b3f788-4aa1-4fce-8085-e2648cfb90cd tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:47.635343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3b3f788-4aa1-4fce-8085-e2648cfb90cd tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:47.635977 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3b3f788-4aa1-4fce-8085-e2648cfb90cd tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:47.636589 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3b3f788-4aa1-4fce-8085-e2648cfb90cd tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:47.637182 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-c3b3f788-4aa1-4fce-8085-e2648cfb90cd tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lazy-loading 'fault' on Instance uuid ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:25:47.679826 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c3b3f788-4aa1-4fce-8085-e2648cfb90cd tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b559d3676324d118771e07248aee539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a8ceb72d38430da081bf1a280ec13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:47.687862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c3b3f788-4aa1-4fce-8085-e2648cfb90cd tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 200 len: 1304 microversion: 2.1 time: 0.124769 Aug 26 18:25:47.688432 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 171/330] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:47 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:47.729319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-cca588bb-3d91-4816-89c4-b368ae9beda1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:47.729946 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-cca588bb-3d91-4816-89c4-b368ae9beda1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:47.736199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cca588bb-3d91-4816-89c4-b368ae9beda1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:47.736680 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cca588bb-3d91-4816-89c4-b368ae9beda1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:47.737175 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cca588bb-3d91-4816-89c4-b368ae9beda1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:47.737866 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cca588bb-3d91-4816-89c4-b368ae9beda1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:47.738364 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cca588bb-3d91-4816-89c4-b368ae9beda1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:47.738783 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cca588bb-3d91-4816-89c4-b368ae9beda1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:47.815594 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-cca588bb-3d91-4816-89c4-b368ae9beda1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:47.823353 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-cca588bb-3d91-4816-89c4-b368ae9beda1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1298 microversion: 2.1 time: 0.098092 Aug 26 18:25:47.823908 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 160/331] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:47 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:47.985846 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1104005555", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:48.024002 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-727dbed1-00bf-432f-8fe8-f883710e2f3f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:48.024881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-727dbed1-00bf-432f-8fe8-f883710e2f3f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:48.031213 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-727dbed1-00bf-432f-8fe8-f883710e2f3f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:48.031889 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-727dbed1-00bf-432f-8fe8-f883710e2f3f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:48.032322 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-727dbed1-00bf-432f-8fe8-f883710e2f3f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:48.033038 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-727dbed1-00bf-432f-8fe8-f883710e2f3f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:48.033480 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-727dbed1-00bf-432f-8fe8-f883710e2f3f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:48.033894 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-727dbed1-00bf-432f-8fe8-f883710e2f3f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:48.036746 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] validate_networks() for None {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:25:48.162420 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-727dbed1-00bf-432f-8fe8-f883710e2f3f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:48.171116 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-727dbed1-00bf-432f-8fe8-f883710e2f3f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:48.172544 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-727dbed1-00bf-432f-8fe8-f883710e2f3f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:48.173716 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-727dbed1-00bf-432f-8fe8-f883710e2f3f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.154073 Aug 26 18:25:48.174306 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 161/332] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:48 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:25:48.331341 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:25:48.332030 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:25:48.332653 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:25:48.333316 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:25:48.333898 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:25:48.348149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:48.349148 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:48.349773 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:48.350942 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:48.351646 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:48.352308 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:48.370703 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Getting quotas for project 1b7e87f26c6748f3a55767285de31cde. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:25:48.374702 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Getting quotas for user 0c70c266fe3a46ebad73127c1f1e5c61 and project 1b7e87f26c6748f3a55767285de31cde. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:25:48.385629 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:25:48.387999 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:25:48.432639 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2328e671-c8e4-4c47-84cf-58f781e38a10 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.450573 Aug 26 18:25:48.433327 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 172/333] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:25:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 18:25:48.444169 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7149a5fe-62e6-41a5-b300-30e2b1037922 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:48.444807 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-7149a5fe-62e6-41a5-b300-30e2b1037922 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:48.497982 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-7149a5fe-62e6-41a5-b300-30e2b1037922 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:48.505024 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-7149a5fe-62e6-41a5-b300-30e2b1037922 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1215 microversion: 2.1 time: 0.064676 Aug 26 18:25:48.505588 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 162/334] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:48 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:48.607906 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9a961054-927a-4afa-9b07-7f3d41614762 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:48.608526 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9a961054-927a-4afa-9b07-7f3d41614762 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:48.619856 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a961054-927a-4afa-9b07-7f3d41614762 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:48.620290 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a961054-927a-4afa-9b07-7f3d41614762 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:48.620752 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a961054-927a-4afa-9b07-7f3d41614762 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:48.621430 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a961054-927a-4afa-9b07-7f3d41614762 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:48.622172 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a961054-927a-4afa-9b07-7f3d41614762 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:48.622782 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a961054-927a-4afa-9b07-7f3d41614762 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:48.710194 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-71779423-c11d-45b5-801f-18ab05ebb40f tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:48.710867 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-71779423-c11d-45b5-801f-18ab05ebb40f tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] [instance: ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:48.724498 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-71779423-c11d-45b5-801f-18ab05ebb40f tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:48.733981 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-71779423-c11d-45b5-801f-18ab05ebb40f tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:48.734465 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-71779423-c11d-45b5-801f-18ab05ebb40f tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:48.735234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-71779423-c11d-45b5-801f-18ab05ebb40f tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:48.735702 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-71779423-c11d-45b5-801f-18ab05ebb40f tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:48.736128 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-71779423-c11d-45b5-801f-18ab05ebb40f tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:48.772187 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-71779423-c11d-45b5-801f-18ab05ebb40f tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] HTTP exception thrown: Instance ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a could not be found. Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-71779423-c11d-45b5-801f-18ab05ebb40f tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Request method failure captured: Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a HTTP/1.1 Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ_4QCg9JuPAQZM5wIHivYkMpUaBP0tCmRo5uUcb3EXzWNds8Fe9hFyaMaeICPf72eRA1n1F-cfpYPQ3q9Wcr6fcWLp3IOgJKgp3oAYItep3ct3NBUrzV8Wt0HwHoZe45f6Jxv8AGy7t3lhbGVKv1IpjJXL1VANAiFWN3RmGHYe8uww Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 62a8ceb72d38430da081bf1a280ec13a Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-VolumesActionsTest-2127694618 Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:25:48.774491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:25:48.775812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_62a8ceb72d38430da081bf1a280ec13a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62a8ceb72d38430da081bf1a280ec13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/62a8ceb72d38430da081bf1a280ec13a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/62a8ceb72d38430da081bf1a280ec13a"}]}] Aug 26 18:25:48.775812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-VolumesActionsTest-2127694618 Aug 26 18:25:48.775812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 62a8ceb72d38430da081bf1a280ec13a Aug 26 18:25:48.775812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-VolumesActionsTest-2127694618 Aug 26 18:25:48.775812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-VolumesActionsTest-2127694618-project Aug 26 18:25:48.775812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:25:48.775812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:25:48.775812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: 9b559d3676324d118771e07248aee539 Aug 26 18:25:48.775812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-VolumesActionsTest-2127694618-project Aug 26 18:25:48.775812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:25:48.775812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a could not be found. Aug 26 18:25:48.775812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': 'ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a'} Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a could not be found. Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:25:48.776497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a could not be found. Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a could not be found. Aug 26 18:25:48.777806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:25:48.778921 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-71779423-c11d-45b5-801f-18ab05ebb40f tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] Returning 404 to user: Instance ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:25:48.778921 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-71779423-c11d-45b5-801f-18ab05ebb40f tempest-VolumesActionsTest-2127694618 tempest-VolumesActionsTest-2127694618-project] 10.222.0.45 "GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a" status: 404 len: 111 microversion: 2.1 time: 0.071348 Aug 26 18:25:48.782146 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 163/335] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:48 2022] GET /compute/v2.1/servers/ab5276cc-4b46-4f9b-ae47-ef6ca4c4238a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 18:25:48.811809 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9a961054-927a-4afa-9b07-7f3d41614762 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:48.822532 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9a961054-927a-4afa-9b07-7f3d41614762 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.218657 Aug 26 18:25:48.823341 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 173/336] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:48 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:48.861370 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-6d19e174-a4b0-48ac-8b22-bce3d0767095 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:48.862182 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-6d19e174-a4b0-48ac-8b22-bce3d0767095 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:48.871015 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d19e174-a4b0-48ac-8b22-bce3d0767095 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:48.876464 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d19e174-a4b0-48ac-8b22-bce3d0767095 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:48.878319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d19e174-a4b0-48ac-8b22-bce3d0767095 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:48.879253 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d19e174-a4b0-48ac-8b22-bce3d0767095 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:48.880862 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d19e174-a4b0-48ac-8b22-bce3d0767095 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:48.882222 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d19e174-a4b0-48ac-8b22-bce3d0767095 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:49.033396 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6d19e174-a4b0-48ac-8b22-bce3d0767095 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:49.041520 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-6d19e174-a4b0-48ac-8b22-bce3d0767095 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1304 microversion: 2.1 time: 0.185393 Aug 26 18:25:49.042078 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 164/337] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:48 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:49.197597 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f026dff8-f553-441e-951c-f85b9e591555 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:49.198114 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f026dff8-f553-441e-951c-f85b9e591555 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:49.204930 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f026dff8-f553-441e-951c-f85b9e591555 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:49.205419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f026dff8-f553-441e-951c-f85b9e591555 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:49.205855 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f026dff8-f553-441e-951c-f85b9e591555 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:49.206553 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f026dff8-f553-441e-951c-f85b9e591555 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:49.206999 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f026dff8-f553-441e-951c-f85b9e591555 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:49.207418 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f026dff8-f553-441e-951c-f85b9e591555 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:49.357575 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f026dff8-f553-441e-951c-f85b9e591555 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:49.366932 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f026dff8-f553-441e-951c-f85b9e591555 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:49.370731 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f026dff8-f553-441e-951c-f85b9e591555 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:49.371926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f026dff8-f553-441e-951c-f85b9e591555 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.180342 Aug 26 18:25:49.372478 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 174/338] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:49 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:49.542568 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-5d9de773-b8bf-4de1-910d-abc7aab13812 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:49.544914 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-5d9de773-b8bf-4de1-910d-abc7aab13812 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:49.561026 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5d9de773-b8bf-4de1-910d-abc7aab13812 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:49.561604 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5d9de773-b8bf-4de1-910d-abc7aab13812 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:49.562158 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5d9de773-b8bf-4de1-910d-abc7aab13812 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:49.562934 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5d9de773-b8bf-4de1-910d-abc7aab13812 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:49.563445 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5d9de773-b8bf-4de1-910d-abc7aab13812 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:49.564547 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5d9de773-b8bf-4de1-910d-abc7aab13812 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:49.709283 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5d9de773-b8bf-4de1-910d-abc7aab13812 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:49.718672 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-5d9de773-b8bf-4de1-910d-abc7aab13812 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1267 microversion: 2.1 time: 0.196209 Aug 26 18:25:49.719613 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 165/339] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:49 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:49.846225 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-19d00400-205c-48e9-8e32-7cc80bc26384 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:49.846971 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-19d00400-205c-48e9-8e32-7cc80bc26384 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:49.853773 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19d00400-205c-48e9-8e32-7cc80bc26384 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:49.854419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19d00400-205c-48e9-8e32-7cc80bc26384 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:49.854966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19d00400-205c-48e9-8e32-7cc80bc26384 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:49.855925 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19d00400-205c-48e9-8e32-7cc80bc26384 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:49.856599 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19d00400-205c-48e9-8e32-7cc80bc26384 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:49.857901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19d00400-205c-48e9-8e32-7cc80bc26384 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:49.993345 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-19d00400-205c-48e9-8e32-7cc80bc26384 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:50.001681 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-19d00400-205c-48e9-8e32-7cc80bc26384 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.159389 Aug 26 18:25:50.002218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 175/340] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:49 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:50.062677 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-26c597d6-a404-4c3c-926e-84f6603eee0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:50.063287 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-26c597d6-a404-4c3c-926e-84f6603eee0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:50.069223 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-26c597d6-a404-4c3c-926e-84f6603eee0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:50.069687 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-26c597d6-a404-4c3c-926e-84f6603eee0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:50.070115 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-26c597d6-a404-4c3c-926e-84f6603eee0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:50.070811 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-26c597d6-a404-4c3c-926e-84f6603eee0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:50.071413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-26c597d6-a404-4c3c-926e-84f6603eee0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:50.072005 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-26c597d6-a404-4c3c-926e-84f6603eee0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:50.245824 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-26c597d6-a404-4c3c-926e-84f6603eee0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:50.254065 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-26c597d6-a404-4c3c-926e-84f6603eee0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1372 microversion: 2.1 time: 0.195294 Aug 26 18:25:50.254633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 166/341] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:50 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:50.325518 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-3f1c82f4-12ea-46d4-955d-42ba09c84116 req-6141b545-c34b-492d-87a9-ee16e931e5fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64b399c3-d3a3-4193-9826-e509b3b9b529", "tag": "b0c5500f-b975-4591-a361-36f0917bc440"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:50.336254 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-3f1c82f4-12ea-46d4-955d-42ba09c84116 req-6141b545-c34b-492d-87a9-ee16e931e5fa service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:50.336699 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-3f1c82f4-12ea-46d4-955d-42ba09c84116 req-6141b545-c34b-492d-87a9-ee16e931e5fa service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:50.337203 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-3f1c82f4-12ea-46d4-955d-42ba09c84116 req-6141b545-c34b-492d-87a9-ee16e931e5fa service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:50.348552 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-3f1c82f4-12ea-46d4-955d-42ba09c84116 req-6141b545-c34b-492d-87a9-ee16e931e5fa service nova] Creating event network-changed:b0c5500f-b975-4591-a361-36f0917bc440 for instance 64b399c3-d3a3-4193-9826-e509b3b9b529 on hv-cinder-85199 Aug 26 18:25:50.353599 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-3f1c82f4-12ea-46d4-955d-42ba09c84116 req-6141b545-c34b-492d-87a9-ee16e931e5fa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032151 Aug 26 18:25:50.354191 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 176/342] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:25:50.395026 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-762f3874-30ef-4e56-bac8-99e357f3e91d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:50.395627 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-762f3874-30ef-4e56-bac8-99e357f3e91d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:50.402130 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-762f3874-30ef-4e56-bac8-99e357f3e91d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:50.402644 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-762f3874-30ef-4e56-bac8-99e357f3e91d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:50.403076 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-762f3874-30ef-4e56-bac8-99e357f3e91d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:50.403771 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-762f3874-30ef-4e56-bac8-99e357f3e91d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:50.404221 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-762f3874-30ef-4e56-bac8-99e357f3e91d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:50.404689 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-762f3874-30ef-4e56-bac8-99e357f3e91d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:50.536822 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-762f3874-30ef-4e56-bac8-99e357f3e91d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:50.545094 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-762f3874-30ef-4e56-bac8-99e357f3e91d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:50.546514 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-762f3874-30ef-4e56-bac8-99e357f3e91d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:50.547670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-762f3874-30ef-4e56-bac8-99e357f3e91d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.156920 Aug 26 18:25:50.548217 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 167/343] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:50 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:50.740582 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9c641396-6590-4bee-9720-8aeeffdde8fd tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:50.741321 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9c641396-6590-4bee-9720-8aeeffdde8fd tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:50.748073 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c641396-6590-4bee-9720-8aeeffdde8fd tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:50.748545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c641396-6590-4bee-9720-8aeeffdde8fd tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:50.749023 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c641396-6590-4bee-9720-8aeeffdde8fd tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:50.749702 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c641396-6590-4bee-9720-8aeeffdde8fd tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:50.750140 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c641396-6590-4bee-9720-8aeeffdde8fd tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:50.750554 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c641396-6590-4bee-9720-8aeeffdde8fd tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:50.822085 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9c641396-6590-4bee-9720-8aeeffdde8fd tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:50.830047 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9c641396-6590-4bee-9720-8aeeffdde8fd tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1267 microversion: 2.1 time: 0.093627 Aug 26 18:25:50.830616 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 177/344] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:50 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:51.025597 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-20ab9923-4a9b-4cbf-872c-074835ad85df tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:51.026279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-20ab9923-4a9b-4cbf-872c-074835ad85df tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:51.033165 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20ab9923-4a9b-4cbf-872c-074835ad85df tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:51.033631 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20ab9923-4a9b-4cbf-872c-074835ad85df tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:51.034143 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20ab9923-4a9b-4cbf-872c-074835ad85df tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:51.034926 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20ab9923-4a9b-4cbf-872c-074835ad85df tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:51.035384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20ab9923-4a9b-4cbf-872c-074835ad85df tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:51.035804 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20ab9923-4a9b-4cbf-872c-074835ad85df tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:51.164048 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-20ab9923-4a9b-4cbf-872c-074835ad85df tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:51.172707 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-20ab9923-4a9b-4cbf-872c-074835ad85df tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.151163 Aug 26 18:25:51.173366 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 168/345] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:51 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:51.279367 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c6c5f9c2-ddcf-48a7-a092-890615ae89f4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:51.280374 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c6c5f9c2-ddcf-48a7-a092-890615ae89f4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:51.290624 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6c5f9c2-ddcf-48a7-a092-890615ae89f4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:51.291499 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6c5f9c2-ddcf-48a7-a092-890615ae89f4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:51.292223 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6c5f9c2-ddcf-48a7-a092-890615ae89f4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:51.293465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6c5f9c2-ddcf-48a7-a092-890615ae89f4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:51.294226 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6c5f9c2-ddcf-48a7-a092-890615ae89f4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:51.295005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6c5f9c2-ddcf-48a7-a092-890615ae89f4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:51.427771 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c6c5f9c2-ddcf-48a7-a092-890615ae89f4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:51.435686 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c6c5f9c2-ddcf-48a7-a092-890615ae89f4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1372 microversion: 2.1 time: 0.162787 Aug 26 18:25:51.436280 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 178/346] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:51 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:51.574708 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-6d8a4e7f-0b51-400f-9a96-42dea4e332ac tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:51.575738 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-6d8a4e7f-0b51-400f-9a96-42dea4e332ac tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:51.586094 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d8a4e7f-0b51-400f-9a96-42dea4e332ac tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:51.586849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d8a4e7f-0b51-400f-9a96-42dea4e332ac tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:51.587610 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d8a4e7f-0b51-400f-9a96-42dea4e332ac tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:51.588783 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d8a4e7f-0b51-400f-9a96-42dea4e332ac tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:51.589561 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d8a4e7f-0b51-400f-9a96-42dea4e332ac tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:51.590267 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d8a4e7f-0b51-400f-9a96-42dea4e332ac tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:51.733264 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6d8a4e7f-0b51-400f-9a96-42dea4e332ac tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:51.741705 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6d8a4e7f-0b51-400f-9a96-42dea4e332ac tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:51.743131 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6d8a4e7f-0b51-400f-9a96-42dea4e332ac tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:51.744266 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-6d8a4e7f-0b51-400f-9a96-42dea4e332ac tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.176219 Aug 26 18:25:51.744823 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 169/347] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:51 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:51.854674 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-27b3046f-c376-4c5c-a024-71f152a08cf8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:51.855689 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-27b3046f-c376-4c5c-a024-71f152a08cf8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:51.863366 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27b3046f-c376-4c5c-a024-71f152a08cf8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:51.863882 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27b3046f-c376-4c5c-a024-71f152a08cf8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:51.864338 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27b3046f-c376-4c5c-a024-71f152a08cf8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:51.865110 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27b3046f-c376-4c5c-a024-71f152a08cf8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:51.865588 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27b3046f-c376-4c5c-a024-71f152a08cf8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:51.866013 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27b3046f-c376-4c5c-a024-71f152a08cf8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:51.929651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-27b3046f-c376-4c5c-a024-71f152a08cf8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:51.937448 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-27b3046f-c376-4c5c-a024-71f152a08cf8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1267 microversion: 2.1 time: 0.089293 Aug 26 18:25:51.938013 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 179/348] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:51 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:52.197746 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2dade9f4-a753-44c2-85fc-a4d34ed26402 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:52.198670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2dade9f4-a753-44c2-85fc-a4d34ed26402 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:52.209494 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2dade9f4-a753-44c2-85fc-a4d34ed26402 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:52.210299 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2dade9f4-a753-44c2-85fc-a4d34ed26402 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:52.211018 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2dade9f4-a753-44c2-85fc-a4d34ed26402 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:52.212157 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2dade9f4-a753-44c2-85fc-a4d34ed26402 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:52.212963 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2dade9f4-a753-44c2-85fc-a4d34ed26402 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:52.213671 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2dade9f4-a753-44c2-85fc-a4d34ed26402 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:52.345941 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2dade9f4-a753-44c2-85fc-a4d34ed26402 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:52.360184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2dade9f4-a753-44c2-85fc-a4d34ed26402 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.168658 Aug 26 18:25:52.361146 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 170/349] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:52 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:52.461122 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-594f58a5-faac-4ed9-8f5b-5ca30a7ba675 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:52.462034 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-594f58a5-faac-4ed9-8f5b-5ca30a7ba675 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:52.470614 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-594f58a5-faac-4ed9-8f5b-5ca30a7ba675 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:52.471113 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-594f58a5-faac-4ed9-8f5b-5ca30a7ba675 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:52.471536 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-594f58a5-faac-4ed9-8f5b-5ca30a7ba675 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:52.472230 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-594f58a5-faac-4ed9-8f5b-5ca30a7ba675 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:52.472680 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-594f58a5-faac-4ed9-8f5b-5ca30a7ba675 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:52.473140 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-594f58a5-faac-4ed9-8f5b-5ca30a7ba675 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:52.610727 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-594f58a5-faac-4ed9-8f5b-5ca30a7ba675 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:52.618810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-594f58a5-faac-4ed9-8f5b-5ca30a7ba675 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1372 microversion: 2.1 time: 0.164314 Aug 26 18:25:52.619375 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 180/350] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:52 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:52.769003 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-6a07f8c9-4a6f-4255-8b5a-e448d67e94be tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:52.769864 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-6a07f8c9-4a6f-4255-8b5a-e448d67e94be tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:52.773457 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:52.776808 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6a07f8c9-4a6f-4255-8b5a-e448d67e94be tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:52.777269 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6a07f8c9-4a6f-4255-8b5a-e448d67e94be tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:52.777858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6a07f8c9-4a6f-4255-8b5a-e448d67e94be tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:52.778551 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6a07f8c9-4a6f-4255-8b5a-e448d67e94be tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:52.778994 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6a07f8c9-4a6f-4255-8b5a-e448d67e94be tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:52.779407 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6a07f8c9-4a6f-4255-8b5a-e448d67e94be tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:52.914195 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6a07f8c9-4a6f-4255-8b5a-e448d67e94be tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:52.917812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=100 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:52.924158 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6a07f8c9-4a6f-4255-8b5a-e448d67e94be tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:52.926355 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6a07f8c9-4a6f-4255-8b5a-e448d67e94be tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:52.927790 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-6a07f8c9-4a6f-4255-8b5a-e448d67e94be tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.164420 Aug 26 18:25:52.929002 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 171/351] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:52 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:52.958167 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5d7a4377-9c5e-45fe-a5e0-9d6ddd587245 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:52.959135 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5d7a4377-9c5e-45fe-a5e0-9d6ddd587245 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:52.969454 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d7a4377-9c5e-45fe-a5e0-9d6ddd587245 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:52.970348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d7a4377-9c5e-45fe-a5e0-9d6ddd587245 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:52.970789 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d7a4377-9c5e-45fe-a5e0-9d6ddd587245 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:52.971580 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d7a4377-9c5e-45fe-a5e0-9d6ddd587245 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:52.972143 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d7a4377-9c5e-45fe-a5e0-9d6ddd587245 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:52.972623 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d7a4377-9c5e-45fe-a5e0-9d6ddd587245 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:53.072534 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5d7a4377-9c5e-45fe-a5e0-9d6ddd587245 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:53.081324 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5d7a4377-9c5e-45fe-a5e0-9d6ddd587245 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1275 microversion: 2.1 time: 0.126775 Aug 26 18:25:53.081932 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 181/352] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:52 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:53.386594 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4e4db4ef-1d32-464b-9cc4-67c459eff27d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:53.387123 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4e4db4ef-1d32-464b-9cc4-67c459eff27d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:53.394146 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4e4db4ef-1d32-464b-9cc4-67c459eff27d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:53.394630 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4e4db4ef-1d32-464b-9cc4-67c459eff27d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:53.395079 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4e4db4ef-1d32-464b-9cc4-67c459eff27d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:53.395771 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4e4db4ef-1d32-464b-9cc4-67c459eff27d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:53.396182 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4e4db4ef-1d32-464b-9cc4-67c459eff27d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:53.396590 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4e4db4ef-1d32-464b-9cc4-67c459eff27d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:53.566912 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-4e4db4ef-1d32-464b-9cc4-67c459eff27d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:53.575358 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4e4db4ef-1d32-464b-9cc4-67c459eff27d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.192851 Aug 26 18:25:53.575964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 172/353] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:53 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:53.641603 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5cbbe03e-7ffa-499b-b65b-8d204bac78ca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:53.642616 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5cbbe03e-7ffa-499b-b65b-8d204bac78ca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:53.651308 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbbe03e-7ffa-499b-b65b-8d204bac78ca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:53.652039 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbbe03e-7ffa-499b-b65b-8d204bac78ca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:53.652772 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbbe03e-7ffa-499b-b65b-8d204bac78ca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:53.654520 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbbe03e-7ffa-499b-b65b-8d204bac78ca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:53.655449 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbbe03e-7ffa-499b-b65b-8d204bac78ca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:53.656637 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbbe03e-7ffa-499b-b65b-8d204bac78ca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:53.878936 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5cbbe03e-7ffa-499b-b65b-8d204bac78ca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:53.887277 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5cbbe03e-7ffa-499b-b65b-8d204bac78ca tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1372 microversion: 2.1 time: 0.251273 Aug 26 18:25:53.888421 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 182/354] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:53 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1372 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:53.951310 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1f1e5d2a-c2c3-48b2-803a-5f128389a131 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:53.952009 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1f1e5d2a-c2c3-48b2-803a-5f128389a131 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:53.959041 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1f1e5d2a-c2c3-48b2-803a-5f128389a131 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:53.959538 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1f1e5d2a-c2c3-48b2-803a-5f128389a131 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:53.959970 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1f1e5d2a-c2c3-48b2-803a-5f128389a131 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:53.960761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1f1e5d2a-c2c3-48b2-803a-5f128389a131 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:53.961664 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1f1e5d2a-c2c3-48b2-803a-5f128389a131 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:53.962246 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1f1e5d2a-c2c3-48b2-803a-5f128389a131 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:54.100350 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1f1e5d2a-c2c3-48b2-803a-5f128389a131 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:54.102408 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-092aadbf-140e-4ca4-ab42-af609392fa87 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:54.103211 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-092aadbf-140e-4ca4-ab42-af609392fa87 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:54.108889 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:54.110216 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1f1e5d2a-c2c3-48b2-803a-5f128389a131 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:54.110503 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-092aadbf-140e-4ca4-ab42-af609392fa87 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:54.110712 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-092aadbf-140e-4ca4-ab42-af609392fa87 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:54.111168 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-092aadbf-140e-4ca4-ab42-af609392fa87 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:54.111852 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1f1e5d2a-c2c3-48b2-803a-5f128389a131 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:54.111966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-092aadbf-140e-4ca4-ab42-af609392fa87 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:54.112298 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-092aadbf-140e-4ca4-ab42-af609392fa87 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:54.112736 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-092aadbf-140e-4ca4-ab42-af609392fa87 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:54.113128 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1f1e5d2a-c2c3-48b2-803a-5f128389a131 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1745 microversion: 2.20 time: 0.165887 Aug 26 18:25:54.113827 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 173/355] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:53 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:25:54.269464 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-092aadbf-140e-4ca4-ab42-af609392fa87 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:54.278858 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-092aadbf-140e-4ca4-ab42-af609392fa87 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1315 microversion: 2.1 time: 0.180116 Aug 26 18:25:54.279496 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 183/356] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:54 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:54.386677 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1427804813", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1811114461", "security_groups": [{"name": "tempest-secgroup-smoke-1399502428"}], "block_device_mapping_v2": [{"uuid": "9482360e-704d-4ae9-92ba-08515ea5b8cc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a8763208-a644-423d-b288-ce6ba4bfee8d"}]}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:54.507139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.network.neutron [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] validate_networks() for [('a8763208-a644-423d-b288-ce6ba4bfee8d', None, None, None, None, None)] {{(pid=120540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:25:54.597192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-75525519-319e-4114-ab5a-90737282e695 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:54.597531 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-75525519-319e-4114-ab5a-90737282e695 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:54.604100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-75525519-319e-4114-ab5a-90737282e695 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:54.604278 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-75525519-319e-4114-ab5a-90737282e695 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:54.604577 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-75525519-319e-4114-ab5a-90737282e695 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:54.605519 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-75525519-319e-4114-ab5a-90737282e695 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:54.605971 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-75525519-319e-4114-ab5a-90737282e695 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:54.606393 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-75525519-319e-4114-ab5a-90737282e695 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:54.782108 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-75525519-319e-4114-ab5a-90737282e695 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:54.798621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-75525519-319e-4114-ab5a-90737282e695 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.205409 Aug 26 18:25:54.799316 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 184/357] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:54 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:54.908686 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cc81cb95-a5fa-4431-a516-55ef1886a4b7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:54.909807 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cc81cb95-a5fa-4431-a516-55ef1886a4b7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:54.916173 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc81cb95-a5fa-4431-a516-55ef1886a4b7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:54.916758 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc81cb95-a5fa-4431-a516-55ef1886a4b7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:54.917426 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc81cb95-a5fa-4431-a516-55ef1886a4b7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:54.918332 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc81cb95-a5fa-4431-a516-55ef1886a4b7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:54.918976 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc81cb95-a5fa-4431-a516-55ef1886a4b7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:54.919746 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc81cb95-a5fa-4431-a516-55ef1886a4b7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:54.939496 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:54.993849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Flavor limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:25:54.995331 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Image limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:25:54.995979 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Flavor pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:25:54.996537 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Image pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:25:54.998032 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:25:55.009922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:55.010826 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:55.011400 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:55.012327 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:55.012811 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:55.013397 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:55.032273 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Getting quotas for project 44c9832086724954853fc474a2a92747. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:25:55.036894 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Getting quotas for user deb80cf02c84476182960a91d69b6da1 and project 44c9832086724954853fc474a2a92747. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:25:55.104986 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Going to run 1 instances... {{(pid=120540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:25:55.107571 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9482360e-704d-4ae9-92ba-08515ea5b8cc',volume_size=None,volume_type=None)] {{(pid=120540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:25:55.109652 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cc81cb95-a5fa-4431-a516-55ef1886a4b7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:55.121086 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cc81cb95-a5fa-4431-a516-55ef1886a4b7 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1372 microversion: 2.1 time: 0.216060 Aug 26 18:25:55.133401 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 185/358] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:54 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1372 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:55.139692 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-62d15497-c973-4d6d-8cfe-aa1821d09ca9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:55.140302 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-62d15497-c973-4d6d-8cfe-aa1821d09ca9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:55.149383 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62d15497-c973-4d6d-8cfe-aa1821d09ca9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:55.149861 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62d15497-c973-4d6d-8cfe-aa1821d09ca9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:55.150483 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62d15497-c973-4d6d-8cfe-aa1821d09ca9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:55.151173 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62d15497-c973-4d6d-8cfe-aa1821d09ca9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:55.151766 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62d15497-c973-4d6d-8cfe-aa1821d09ca9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:55.152329 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62d15497-c973-4d6d-8cfe-aa1821d09ca9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:55.331718 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-062a8f1b-8fdc-43a9-8ddc-6ffef8eb4274 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.949644 Aug 26 18:25:55.336774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 174/359] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:25:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 18:25:55.350910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1df9517e-ca74-4383-9a83-308ae3cbdc5e tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:55.356307 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1df9517e-ca74-4383-9a83-308ae3cbdc5e tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:55.370119 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1df9517e-ca74-4383-9a83-308ae3cbdc5e tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:55.370258 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1df9517e-ca74-4383-9a83-308ae3cbdc5e tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:55.370760 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1df9517e-ca74-4383-9a83-308ae3cbdc5e tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:55.371425 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1df9517e-ca74-4383-9a83-308ae3cbdc5e tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:55.371995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1df9517e-ca74-4383-9a83-308ae3cbdc5e tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:55.372708 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1df9517e-ca74-4383-9a83-308ae3cbdc5e tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:55.470409 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-62d15497-c973-4d6d-8cfe-aa1821d09ca9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:55.481017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-62d15497-c973-4d6d-8cfe-aa1821d09ca9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:55.486580 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-62d15497-c973-4d6d-8cfe-aa1821d09ca9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:55.487971 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-62d15497-c973-4d6d-8cfe-aa1821d09ca9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1745 microversion: 2.20 time: 0.353454 Aug 26 18:25:55.504843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 186/360] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:55 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1745 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:55.504843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1975893f-b565-40d3-a46f-fb061014f31a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:55.504843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1975893f-b565-40d3-a46f-fb061014f31a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:55.546081 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1df9517e-ca74-4383-9a83-308ae3cbdc5e tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:55.555288 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1df9517e-ca74-4383-9a83-308ae3cbdc5e tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1315 microversion: 2.1 time: 0.221379 Aug 26 18:25:55.556762 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 175/361] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:55 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:55.626857 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1975893f-b565-40d3-a46f-fb061014f31a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:55.634905 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1975893f-b565-40d3-a46f-fb061014f31a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1095 microversion: 2.1 time: 0.142983 Aug 26 18:25:55.635747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 187/362] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:55 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1095 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:55.819730 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4fa14089-bdac-4806-885e-0ad963731e5f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:55.820779 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4fa14089-bdac-4806-885e-0ad963731e5f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:55.843430 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4fa14089-bdac-4806-885e-0ad963731e5f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:55.844086 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4fa14089-bdac-4806-885e-0ad963731e5f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:55.844580 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4fa14089-bdac-4806-885e-0ad963731e5f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:55.845337 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4fa14089-bdac-4806-885e-0ad963731e5f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:55.848284 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4fa14089-bdac-4806-885e-0ad963731e5f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:55.848937 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4fa14089-bdac-4806-885e-0ad963731e5f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:56.028081 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-4fa14089-bdac-4806-885e-0ad963731e5f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:56.039540 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4fa14089-bdac-4806-885e-0ad963731e5f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.221299 Aug 26 18:25:56.040399 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 176/363] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:55 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:56.144596 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c7cbfc82-743d-47c5-b1d8-f63fe1cc234b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:56.147928 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c7cbfc82-743d-47c5-b1d8-f63fe1cc234b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:56.164607 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7cbfc82-743d-47c5-b1d8-f63fe1cc234b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:56.166203 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7cbfc82-743d-47c5-b1d8-f63fe1cc234b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:56.167078 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7cbfc82-743d-47c5-b1d8-f63fe1cc234b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:56.170217 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7cbfc82-743d-47c5-b1d8-f63fe1cc234b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:56.171513 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7cbfc82-743d-47c5-b1d8-f63fe1cc234b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:56.176303 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7cbfc82-743d-47c5-b1d8-f63fe1cc234b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:56.207880 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-20eea3d1-535c-4445-9fa8-2798787773ea req-cc20ee5d-f6db-4a4b-8897-2c0e701daa3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12257499-71a4-46e5-9264-9e2f3a407939", "tag": "727e4962-72eb-4dc3-8254-9668facff5d6"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:56.226492 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-20eea3d1-535c-4445-9fa8-2798787773ea req-cc20ee5d-f6db-4a4b-8897-2c0e701daa3f service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:56.229324 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-20eea3d1-535c-4445-9fa8-2798787773ea req-cc20ee5d-f6db-4a4b-8897-2c0e701daa3f service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:56.231489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-20eea3d1-535c-4445-9fa8-2798787773ea req-cc20ee5d-f6db-4a4b-8897-2c0e701daa3f service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:56.263532 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-20eea3d1-535c-4445-9fa8-2798787773ea req-cc20ee5d-f6db-4a4b-8897-2c0e701daa3f service nova] Creating event network-changed:727e4962-72eb-4dc3-8254-9668facff5d6 for instance 12257499-71a4-46e5-9264-9e2f3a407939 on hv-cinder-85199 Aug 26 18:25:56.272796 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-20eea3d1-535c-4445-9fa8-2798787773ea req-cc20ee5d-f6db-4a4b-8897-2c0e701daa3f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072288 Aug 26 18:25:56.273899 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 177/364] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:25:56.529404 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c7cbfc82-743d-47c5-b1d8-f63fe1cc234b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:56.532324 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1b13468a-6041-431a-a6c3-1a86a7968c2f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:56.533113 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1b13468a-6041-431a-a6c3-1a86a7968c2f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:56.538491 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c7cbfc82-743d-47c5-b1d8-f63fe1cc234b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1372 microversion: 2.1 time: 0.398697 Aug 26 18:25:56.544799 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1b13468a-6041-431a-a6c3-1a86a7968c2f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:56.548165 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1b13468a-6041-431a-a6c3-1a86a7968c2f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:56.551184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1b13468a-6041-431a-a6c3-1a86a7968c2f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:56.552564 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1b13468a-6041-431a-a6c3-1a86a7968c2f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:56.552853 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 188/365] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:56 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1372 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:56.553704 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1b13468a-6041-431a-a6c3-1a86a7968c2f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:56.555450 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1b13468a-6041-431a-a6c3-1a86a7968c2f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:56.580054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b5dea4e2-073a-423e-9e9b-129ecda1919f tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:56.583769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b5dea4e2-073a-423e-9e9b-129ecda1919f tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:56.597198 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5dea4e2-073a-423e-9e9b-129ecda1919f tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:56.597702 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5dea4e2-073a-423e-9e9b-129ecda1919f tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:56.603327 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5dea4e2-073a-423e-9e9b-129ecda1919f tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:56.604267 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5dea4e2-073a-423e-9e9b-129ecda1919f tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:56.604758 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5dea4e2-073a-423e-9e9b-129ecda1919f tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:56.605187 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5dea4e2-073a-423e-9e9b-129ecda1919f tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:56.774518 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1b13468a-6041-431a-a6c3-1a86a7968c2f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:56.787019 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1b13468a-6041-431a-a6c3-1a86a7968c2f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:56.788971 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1b13468a-6041-431a-a6c3-1a86a7968c2f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:56.790321 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1b13468a-6041-431a-a6c3-1a86a7968c2f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1745 microversion: 2.20 time: 0.282512 Aug 26 18:25:56.791190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 178/366] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:56 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1745 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:56.796582 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d1f16f5c-71af-41dd-8a67-3ebd4d7a2a43 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:56.797480 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-d1f16f5c-71af-41dd-8a67-3ebd4d7a2a43 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:56.805573 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d1f16f5c-71af-41dd-8a67-3ebd4d7a2a43 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:56.806191 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d1f16f5c-71af-41dd-8a67-3ebd4d7a2a43 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:56.806626 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d1f16f5c-71af-41dd-8a67-3ebd4d7a2a43 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:56.807534 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d1f16f5c-71af-41dd-8a67-3ebd4d7a2a43 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:56.808255 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d1f16f5c-71af-41dd-8a67-3ebd4d7a2a43 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:56.809225 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d1f16f5c-71af-41dd-8a67-3ebd4d7a2a43 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:56.826171 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b5dea4e2-073a-423e-9e9b-129ecda1919f tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:56.837609 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b5dea4e2-073a-423e-9e9b-129ecda1919f tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1315 microversion: 2.1 time: 0.266096 Aug 26 18:25:56.838990 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 189/367] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:56 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:56.894378 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d1f16f5c-71af-41dd-8a67-3ebd4d7a2a43 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:56.904391 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-d1f16f5c-71af-41dd-8a67-3ebd4d7a2a43 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1193 microversion: 2.1 time: 0.111744 Aug 26 18:25:56.905374 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 179/368] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:56 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1193 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:57.061408 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2039791e-9668-4cc5-8352-71b3c9c666d8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:57.061936 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2039791e-9668-4cc5-8352-71b3c9c666d8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:57.076893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2039791e-9668-4cc5-8352-71b3c9c666d8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:57.077415 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2039791e-9668-4cc5-8352-71b3c9c666d8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:57.078488 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2039791e-9668-4cc5-8352-71b3c9c666d8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:57.079158 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2039791e-9668-4cc5-8352-71b3c9c666d8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:57.079521 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2039791e-9668-4cc5-8352-71b3c9c666d8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:57.079947 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2039791e-9668-4cc5-8352-71b3c9c666d8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:57.251278 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2039791e-9668-4cc5-8352-71b3c9c666d8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:57.261116 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2039791e-9668-4cc5-8352-71b3c9c666d8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.204383 Aug 26 18:25:57.270454 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 190/369] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:57 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:57.562748 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e144cf4a-2939-4ecf-8416-01643adf15fd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:57.564000 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e144cf4a-2939-4ecf-8416-01643adf15fd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:57.573974 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e144cf4a-2939-4ecf-8416-01643adf15fd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:57.574730 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e144cf4a-2939-4ecf-8416-01643adf15fd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:57.575389 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e144cf4a-2939-4ecf-8416-01643adf15fd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:57.576384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e144cf4a-2939-4ecf-8416-01643adf15fd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:57.577231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e144cf4a-2939-4ecf-8416-01643adf15fd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:57.577831 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e144cf4a-2939-4ecf-8416-01643adf15fd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:57.769311 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e144cf4a-2939-4ecf-8416-01643adf15fd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:57.778583 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e144cf4a-2939-4ecf-8416-01643adf15fd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1372 microversion: 2.1 time: 0.222294 Aug 26 18:25:57.779552 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 180/370] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:57 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:57.814340 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0becb4b3-dae1-4ff9-93ba-d1cf2efb46f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:57.815042 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0becb4b3-dae1-4ff9-93ba-d1cf2efb46f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:57.822744 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0becb4b3-dae1-4ff9-93ba-d1cf2efb46f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:57.823923 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0becb4b3-dae1-4ff9-93ba-d1cf2efb46f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:57.824638 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0becb4b3-dae1-4ff9-93ba-d1cf2efb46f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:57.825481 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0becb4b3-dae1-4ff9-93ba-d1cf2efb46f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:57.826044 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0becb4b3-dae1-4ff9-93ba-d1cf2efb46f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:57.826656 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0becb4b3-dae1-4ff9-93ba-d1cf2efb46f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:57.859291 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-34b6f1d8-0b8b-4316-99fb-3950a50101b1 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:57.860093 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-34b6f1d8-0b8b-4316-99fb-3950a50101b1 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:57.870570 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-34b6f1d8-0b8b-4316-99fb-3950a50101b1 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:57.884443 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-34b6f1d8-0b8b-4316-99fb-3950a50101b1 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:57.884954 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-34b6f1d8-0b8b-4316-99fb-3950a50101b1 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:57.885711 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-34b6f1d8-0b8b-4316-99fb-3950a50101b1 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:57.887003 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-34b6f1d8-0b8b-4316-99fb-3950a50101b1 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:57.887003 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-34b6f1d8-0b8b-4316-99fb-3950a50101b1 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:58.087717 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0becb4b3-dae1-4ff9-93ba-d1cf2efb46f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:58.098165 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0becb4b3-dae1-4ff9-93ba-d1cf2efb46f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:58.098667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-34b6f1d8-0b8b-4316-99fb-3950a50101b1 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:58.109308 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0becb4b3-dae1-4ff9-93ba-d1cf2efb46f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:58.109308 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0becb4b3-dae1-4ff9-93ba-d1cf2efb46f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1740 microversion: 2.20 time: 0.291502 Aug 26 18:25:58.118001 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 191/371] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:57 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1740 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:58.123345 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-34b6f1d8-0b8b-4316-99fb-3950a50101b1 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1315 microversion: 2.1 time: 0.267612 Aug 26 18:25:58.124243 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 181/372] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:57 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:25:58.124448 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f0053991-b291-4339-95a0-f5a4a0fce693 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:58.135105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f0053991-b291-4339-95a0-f5a4a0fce693 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:58.135105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0053991-b291-4339-95a0-f5a4a0fce693 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:58.135105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0053991-b291-4339-95a0-f5a4a0fce693 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:58.135105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0053991-b291-4339-95a0-f5a4a0fce693 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:58.135519 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0053991-b291-4339-95a0-f5a4a0fce693 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:58.135519 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0053991-b291-4339-95a0-f5a4a0fce693 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:58.135519 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0053991-b291-4339-95a0-f5a4a0fce693 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:58.212241 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f0053991-b291-4339-95a0-f5a4a0fce693 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:58.220494 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f0053991-b291-4339-95a0-f5a4a0fce693 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1211 microversion: 2.1 time: 0.101235 Aug 26 18:25:58.234765 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 192/373] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:58 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1211 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:58.296282 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-b87da589-5963-48ac-b77a-7f7adb2a2fc9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:58.299432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-b87da589-5963-48ac-b77a-7f7adb2a2fc9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:58.304467 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b87da589-5963-48ac-b77a-7f7adb2a2fc9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:58.304974 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b87da589-5963-48ac-b77a-7f7adb2a2fc9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:58.305409 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b87da589-5963-48ac-b77a-7f7adb2a2fc9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:58.306104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b87da589-5963-48ac-b77a-7f7adb2a2fc9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:58.306545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b87da589-5963-48ac-b77a-7f7adb2a2fc9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:58.306961 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b87da589-5963-48ac-b77a-7f7adb2a2fc9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:58.684214 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b87da589-5963-48ac-b77a-7f7adb2a2fc9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:58.701527 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-b87da589-5963-48ac-b77a-7f7adb2a2fc9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.420789 Aug 26 18:25:58.703009 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 182/374] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:58 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:58.802113 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-493d064a-34df-467d-a22b-573d7c5f3dad tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:58.805587 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-493d064a-34df-467d-a22b-573d7c5f3dad tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:58.819379 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=4 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:25:58.831092 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-493d064a-34df-467d-a22b-573d7c5f3dad tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:58.831855 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-493d064a-34df-467d-a22b-573d7c5f3dad tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:58.832455 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-493d064a-34df-467d-a22b-573d7c5f3dad tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:58.833650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-493d064a-34df-467d-a22b-573d7c5f3dad tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:58.835285 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-493d064a-34df-467d-a22b-573d7c5f3dad tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:58.836630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-493d064a-34df-467d-a22b-573d7c5f3dad tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:59.128936 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1637ccec-a5ce-4e01-8bd1-4895ae9f3e1a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:59.129799 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1637ccec-a5ce-4e01-8bd1-4895ae9f3e1a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:59.141959 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1637ccec-a5ce-4e01-8bd1-4895ae9f3e1a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:59.149530 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1637ccec-a5ce-4e01-8bd1-4895ae9f3e1a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:59.151396 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1637ccec-a5ce-4e01-8bd1-4895ae9f3e1a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:59.157897 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1637ccec-a5ce-4e01-8bd1-4895ae9f3e1a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:59.164699 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1637ccec-a5ce-4e01-8bd1-4895ae9f3e1a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:59.165507 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1637ccec-a5ce-4e01-8bd1-4895ae9f3e1a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:59.301891 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-493d064a-34df-467d-a22b-573d7c5f3dad tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:59.325780 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-493d064a-34df-467d-a22b-573d7c5f3dad tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1372 microversion: 2.1 time: 0.530079 Aug 26 18:25:59.345187 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 193/375] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:58 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1372 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:59.351631 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e0c55ad7-c561-44f7-9528-47df8917cc14 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:59.354764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e0c55ad7-c561-44f7-9528-47df8917cc14 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:59.372345 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0c55ad7-c561-44f7-9528-47df8917cc14 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:59.373396 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0c55ad7-c561-44f7-9528-47df8917cc14 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:59.374064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0c55ad7-c561-44f7-9528-47df8917cc14 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:59.375847 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0c55ad7-c561-44f7-9528-47df8917cc14 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:59.379832 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0c55ad7-c561-44f7-9528-47df8917cc14 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:59.381483 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0c55ad7-c561-44f7-9528-47df8917cc14 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:59.596073 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1637ccec-a5ce-4e01-8bd1-4895ae9f3e1a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:59.617180 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1637ccec-a5ce-4e01-8bd1-4895ae9f3e1a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:59.619166 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1637ccec-a5ce-4e01-8bd1-4895ae9f3e1a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:59.622690 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1637ccec-a5ce-4e01-8bd1-4895ae9f3e1a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1740 microversion: 2.20 time: 0.498069 Aug 26 18:25:59.629497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 183/376] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:25:59 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1740 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:25:59.637040 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-deccaf1b-9298-4589-8179-1dce00f97cf1 req-ce3387f3-9c02-4289-ab39-3361f583609c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b399c3-d3a3-4193-9826-e509b3b9b529", "name": "network-vif-plugged", "status": "completed", "tag": "b0c5500f-b975-4591-a361-36f0917bc440"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:25:59.648121 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e0c55ad7-c561-44f7-9528-47df8917cc14 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:25:59.658601 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e0c55ad7-c561-44f7-9528-47df8917cc14 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1315 microversion: 2.1 time: 0.311811 Aug 26 18:25:59.660386 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 194/377] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:59 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:25:59.662501 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-deccaf1b-9298-4589-8179-1dce00f97cf1 req-ce3387f3-9c02-4289-ab39-3361f583609c service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:59.664018 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-deccaf1b-9298-4589-8179-1dce00f97cf1 req-ce3387f3-9c02-4289-ab39-3361f583609c service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:59.665624 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-deccaf1b-9298-4589-8179-1dce00f97cf1 req-ce3387f3-9c02-4289-ab39-3361f583609c service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:59.685893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-99261640-deb2-4800-adb5-664ce071dca1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:59.687593 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-99261640-deb2-4800-adb5-664ce071dca1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:59.706196 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99261640-deb2-4800-adb5-664ce071dca1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:59.706991 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99261640-deb2-4800-adb5-664ce071dca1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:59.709752 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99261640-deb2-4800-adb5-664ce071dca1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:59.711364 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99261640-deb2-4800-adb5-664ce071dca1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:59.712196 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99261640-deb2-4800-adb5-664ce071dca1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:59.714727 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-deccaf1b-9298-4589-8179-1dce00f97cf1 req-ce3387f3-9c02-4289-ab39-3361f583609c service nova] Creating event network-vif-plugged:b0c5500f-b975-4591-a361-36f0917bc440 for instance 64b399c3-d3a3-4193-9826-e509b3b9b529 on hv-cinder-85199 Aug 26 18:25:59.715901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99261640-deb2-4800-adb5-664ce071dca1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:59.723397 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-deccaf1b-9298-4589-8179-1dce00f97cf1 req-ce3387f3-9c02-4289-ab39-3361f583609c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092276 Aug 26 18:25:59.733204 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 184/378] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:25:59.744079 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c254266e-81a9-4fef-bf9a-fd29f6e4dda6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:25:59.745362 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c254266e-81a9-4fef-bf9a-fd29f6e4dda6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:25:59.762393 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c254266e-81a9-4fef-bf9a-fd29f6e4dda6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:59.763066 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c254266e-81a9-4fef-bf9a-fd29f6e4dda6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:59.765398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c254266e-81a9-4fef-bf9a-fd29f6e4dda6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:25:59.766333 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c254266e-81a9-4fef-bf9a-fd29f6e4dda6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:25:59.774291 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c254266e-81a9-4fef-bf9a-fd29f6e4dda6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:25:59.775249 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c254266e-81a9-4fef-bf9a-fd29f6e4dda6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:00.057748 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c254266e-81a9-4fef-bf9a-fd29f6e4dda6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:00.072915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c254266e-81a9-4fef-bf9a-fd29f6e4dda6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.338146 Aug 26 18:26:00.073525 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 185/379] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:59 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:00.231692 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-99261640-deb2-4800-adb5-664ce071dca1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:00.243618 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-99261640-deb2-4800-adb5-664ce071dca1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1267 microversion: 2.1 time: 0.581980 Aug 26 18:26:00.257613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 195/380] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:25:59 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1267 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:00.349867 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-02b47370-e945-4cf5-a23c-251f438c2787 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:00.350821 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-02b47370-e945-4cf5-a23c-251f438c2787 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:00.359448 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-02b47370-e945-4cf5-a23c-251f438c2787 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:00.360239 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-02b47370-e945-4cf5-a23c-251f438c2787 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:00.360894 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-02b47370-e945-4cf5-a23c-251f438c2787 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:00.361798 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-02b47370-e945-4cf5-a23c-251f438c2787 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:00.362433 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-02b47370-e945-4cf5-a23c-251f438c2787 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:00.363091 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-02b47370-e945-4cf5-a23c-251f438c2787 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:00.656389 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-69cd1a9b-e28f-43fc-82d6-51ac3a90568a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:00.657188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-69cd1a9b-e28f-43fc-82d6-51ac3a90568a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:00.679720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-02b47370-e945-4cf5-a23c-251f438c2787 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:00.680167 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69cd1a9b-e28f-43fc-82d6-51ac3a90568a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:00.682229 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69cd1a9b-e28f-43fc-82d6-51ac3a90568a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:00.686284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69cd1a9b-e28f-43fc-82d6-51ac3a90568a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:00.687225 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69cd1a9b-e28f-43fc-82d6-51ac3a90568a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:00.687780 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69cd1a9b-e28f-43fc-82d6-51ac3a90568a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:00.688212 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69cd1a9b-e28f-43fc-82d6-51ac3a90568a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:00.688334 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-02b47370-e945-4cf5-a23c-251f438c2787 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1372 microversion: 2.1 time: 0.345381 Aug 26 18:26:00.700746 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 186/381] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:00 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1372 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:00.703273 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-612b9169-c0d7-461c-9c1e-6568a0a66f4b tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:00.713617 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-612b9169-c0d7-461c-9c1e-6568a0a66f4b tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:00.720065 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-612b9169-c0d7-461c-9c1e-6568a0a66f4b tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:00.725229 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-612b9169-c0d7-461c-9c1e-6568a0a66f4b tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:00.725802 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-612b9169-c0d7-461c-9c1e-6568a0a66f4b tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:00.726530 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-612b9169-c0d7-461c-9c1e-6568a0a66f4b tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:00.726985 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-612b9169-c0d7-461c-9c1e-6568a0a66f4b tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:00.727456 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-612b9169-c0d7-461c-9c1e-6568a0a66f4b tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:00.947542 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-69cd1a9b-e28f-43fc-82d6-51ac3a90568a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:00.960046 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-69cd1a9b-e28f-43fc-82d6-51ac3a90568a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:00.961742 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-69cd1a9b-e28f-43fc-82d6-51ac3a90568a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:00.963360 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-69cd1a9b-e28f-43fc-82d6-51ac3a90568a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1740 microversion: 2.20 time: 0.315343 Aug 26 18:26:00.980756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 196/382] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:00 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1740 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:26:01.097478 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c4125d47-9a7d-4fa9-a590-f0d8d03a38b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:01.098374 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c4125d47-9a7d-4fa9-a590-f0d8d03a38b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:01.110102 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4125d47-9a7d-4fa9-a590-f0d8d03a38b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:01.110885 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4125d47-9a7d-4fa9-a590-f0d8d03a38b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:01.113404 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4125d47-9a7d-4fa9-a590-f0d8d03a38b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:01.114724 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4125d47-9a7d-4fa9-a590-f0d8d03a38b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:01.116640 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4125d47-9a7d-4fa9-a590-f0d8d03a38b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:01.121404 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4125d47-9a7d-4fa9-a590-f0d8d03a38b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:01.238006 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-612b9169-c0d7-461c-9c1e-6568a0a66f4b tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:01.246807 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-612b9169-c0d7-461c-9c1e-6568a0a66f4b tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1315 microversion: 2.1 time: 0.556505 Aug 26 18:26:01.254331 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 187/383] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:00 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:01.273094 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-20f5d6e1-3862-4ae6-ac0b-531faa651a70 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:01.278590 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-20f5d6e1-3862-4ae6-ac0b-531faa651a70 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:01.288289 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20f5d6e1-3862-4ae6-ac0b-531faa651a70 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:01.293496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20f5d6e1-3862-4ae6-ac0b-531faa651a70 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:01.294188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20f5d6e1-3862-4ae6-ac0b-531faa651a70 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:01.297814 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20f5d6e1-3862-4ae6-ac0b-531faa651a70 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:01.299849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20f5d6e1-3862-4ae6-ac0b-531faa651a70 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:01.303478 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20f5d6e1-3862-4ae6-ac0b-531faa651a70 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:01.477224 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c4125d47-9a7d-4fa9-a590-f0d8d03a38b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:01.486007 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c4125d47-9a7d-4fa9-a590-f0d8d03a38b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.394018 Aug 26 18:26:01.492520 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 197/384] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:01 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:01.619456 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-20f5d6e1-3862-4ae6-ac0b-531faa651a70 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:01.635567 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-20f5d6e1-3862-4ae6-ac0b-531faa651a70 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1267 microversion: 2.1 time: 0.366412 Aug 26 18:26:01.637084 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 188/385] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:01 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1267 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:26:01.712425 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1b7f4823-f934-4e81-8647-444d20a07965 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:01.713109 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1b7f4823-f934-4e81-8647-444d20a07965 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:01.726538 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b7f4823-f934-4e81-8647-444d20a07965 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:01.727112 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b7f4823-f934-4e81-8647-444d20a07965 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:01.727654 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b7f4823-f934-4e81-8647-444d20a07965 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:01.728616 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b7f4823-f934-4e81-8647-444d20a07965 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:01.729136 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b7f4823-f934-4e81-8647-444d20a07965 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:01.729531 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b7f4823-f934-4e81-8647-444d20a07965 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:01.773390 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-d88aa143-5f49-46ac-88c6-9be00e20bc50 req-20eb315e-0d88-4d5d-94c6-9abcf9cdbdad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed32b7d-a792-49b2-84e7-962f4d537501", "name": "network-vif-plugged", "status": "completed", "tag": "ae3cb7b6-5071-4281-b758-acbb49eab67f"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:01.794486 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-d88aa143-5f49-46ac-88c6-9be00e20bc50 req-20eb315e-0d88-4d5d-94c6-9abcf9cdbdad service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:01.794966 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-d88aa143-5f49-46ac-88c6-9be00e20bc50 req-20eb315e-0d88-4d5d-94c6-9abcf9cdbdad service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:01.809136 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-d88aa143-5f49-46ac-88c6-9be00e20bc50 req-20eb315e-0d88-4d5d-94c6-9abcf9cdbdad service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:01.852343 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-d88aa143-5f49-46ac-88c6-9be00e20bc50 req-20eb315e-0d88-4d5d-94c6-9abcf9cdbdad service nova] Creating event network-vif-plugged:ae3cb7b6-5071-4281-b758-acbb49eab67f for instance 1ed32b7d-a792-49b2-84e7-962f4d537501 on hv-cinder-85199 Aug 26 18:26:01.872180 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-d88aa143-5f49-46ac-88c6-9be00e20bc50 req-20eb315e-0d88-4d5d-94c6-9abcf9cdbdad service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100590 Aug 26 18:26:01.877703 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 189/386] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:26:01.886846 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-2655b61f-183e-4f41-8b53-3aa8f0ce8ecb req-cf45532a-4e30-4526-b03f-2be960443e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570e7fd4-4295-4f3c-9d2a-02f704ea6100", "tag": "fa397c67-c193-42fd-b326-362149109be9"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:01.912561 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2655b61f-183e-4f41-8b53-3aa8f0ce8ecb req-cf45532a-4e30-4526-b03f-2be960443e0e service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:01.915578 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2655b61f-183e-4f41-8b53-3aa8f0ce8ecb req-cf45532a-4e30-4526-b03f-2be960443e0e service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:01.916212 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2655b61f-183e-4f41-8b53-3aa8f0ce8ecb req-cf45532a-4e30-4526-b03f-2be960443e0e service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:01.934870 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-2655b61f-183e-4f41-8b53-3aa8f0ce8ecb req-cf45532a-4e30-4526-b03f-2be960443e0e service nova] Creating event network-changed:fa397c67-c193-42fd-b326-362149109be9 for instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 on hv-cinder-85199 Aug 26 18:26:01.945743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-2655b61f-183e-4f41-8b53-3aa8f0ce8ecb req-cf45532a-4e30-4526-b03f-2be960443e0e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065495 Aug 26 18:26:01.954273 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 190/387] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:26:01.999995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ffd20893-39d2-4690-bf4a-6d068cb4d4ea tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:02.002570 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ffd20893-39d2-4690-bf4a-6d068cb4d4ea tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:02.025232 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ffd20893-39d2-4690-bf4a-6d068cb4d4ea tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:02.026037 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ffd20893-39d2-4690-bf4a-6d068cb4d4ea tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:02.026636 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ffd20893-39d2-4690-bf4a-6d068cb4d4ea tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:02.027510 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ffd20893-39d2-4690-bf4a-6d068cb4d4ea tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:02.028105 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ffd20893-39d2-4690-bf4a-6d068cb4d4ea tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:02.028688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ffd20893-39d2-4690-bf4a-6d068cb4d4ea tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:02.076867 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1b7f4823-f934-4e81-8647-444d20a07965 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:02.092806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1b7f4823-f934-4e81-8647-444d20a07965 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1372 microversion: 2.1 time: 0.382808 Aug 26 18:26:02.093737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 198/388] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:01 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1372 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:02.265803 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ffd20893-39d2-4690-bf4a-6d068cb4d4ea tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:02.274555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a074c590-d110-4523-960a-9d58fa3eee62 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:02.276978 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a074c590-d110-4523-960a-9d58fa3eee62 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:02.291225 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=100 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:02.308738 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a074c590-d110-4523-960a-9d58fa3eee62 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:02.313906 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a074c590-d110-4523-960a-9d58fa3eee62 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:02.315363 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a074c590-d110-4523-960a-9d58fa3eee62 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:02.319441 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a074c590-d110-4523-960a-9d58fa3eee62 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:02.320236 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a074c590-d110-4523-960a-9d58fa3eee62 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:02.320628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ffd20893-39d2-4690-bf4a-6d068cb4d4ea tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:02.321330 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a074c590-d110-4523-960a-9d58fa3eee62 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:02.323088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ffd20893-39d2-4690-bf4a-6d068cb4d4ea tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:02.330188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ffd20893-39d2-4690-bf4a-6d068cb4d4ea tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1740 microversion: 2.20 time: 0.335700 Aug 26 18:26:02.332012 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 191/389] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:01 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1740 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:02.512941 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-5afff2a8-805a-4fdc-ba0d-c59958c335d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:02.514036 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-5afff2a8-805a-4fdc-ba0d-c59958c335d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:02.527685 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5afff2a8-805a-4fdc-ba0d-c59958c335d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:02.530610 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5afff2a8-805a-4fdc-ba0d-c59958c335d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:02.532120 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5afff2a8-805a-4fdc-ba0d-c59958c335d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:02.535074 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5afff2a8-805a-4fdc-ba0d-c59958c335d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:02.536974 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5afff2a8-805a-4fdc-ba0d-c59958c335d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:02.538071 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5afff2a8-805a-4fdc-ba0d-c59958c335d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:02.626732 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a074c590-d110-4523-960a-9d58fa3eee62 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:02.641104 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a074c590-d110-4523-960a-9d58fa3eee62 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1315 microversion: 2.1 time: 0.370331 Aug 26 18:26:02.651240 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 199/390] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:02 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:26:02.659158 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b5c429bc-782c-462d-a96b-c08ab2d514e6 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:02.661022 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b5c429bc-782c-462d-a96b-c08ab2d514e6 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:02.668626 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5c429bc-782c-462d-a96b-c08ab2d514e6 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:02.669535 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5c429bc-782c-462d-a96b-c08ab2d514e6 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:02.670620 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5c429bc-782c-462d-a96b-c08ab2d514e6 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:02.671580 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5c429bc-782c-462d-a96b-c08ab2d514e6 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:02.672288 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5c429bc-782c-462d-a96b-c08ab2d514e6 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:02.672965 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5c429bc-782c-462d-a96b-c08ab2d514e6 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:02.915679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b5c429bc-782c-462d-a96b-c08ab2d514e6 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:02.927494 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b5c429bc-782c-462d-a96b-c08ab2d514e6 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1267 microversion: 2.1 time: 0.274795 Aug 26 18:26:02.928088 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 200/391] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:02 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1267 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:03.001492 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5afff2a8-805a-4fdc-ba0d-c59958c335d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:03.018391 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-5afff2a8-805a-4fdc-ba0d-c59958c335d5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.505723 Aug 26 18:26:03.030027 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 192/392] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:02 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:03.117632 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-584be13f-26ac-4c02-945a-9f27ed78d55e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:03.118871 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-584be13f-26ac-4c02-945a-9f27ed78d55e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:03.140618 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-584be13f-26ac-4c02-945a-9f27ed78d55e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:03.141157 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-584be13f-26ac-4c02-945a-9f27ed78d55e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:03.141598 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-584be13f-26ac-4c02-945a-9f27ed78d55e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:03.142318 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-584be13f-26ac-4c02-945a-9f27ed78d55e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:03.143084 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-584be13f-26ac-4c02-945a-9f27ed78d55e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:03.143488 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-584be13f-26ac-4c02-945a-9f27ed78d55e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:03.364627 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c4465e1b-08ce-4b61-9b9f-15e762844b71 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:03.369133 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c4465e1b-08ce-4b61-9b9f-15e762844b71 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:03.369741 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-584be13f-26ac-4c02-945a-9f27ed78d55e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:03.382374 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-584be13f-26ac-4c02-945a-9f27ed78d55e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1566 microversion: 2.1 time: 0.270780 Aug 26 18:26:03.383529 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c4465e1b-08ce-4b61-9b9f-15e762844b71 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:03.385632 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 201/393] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:03 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1566 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:03.386755 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c4465e1b-08ce-4b61-9b9f-15e762844b71 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:03.387339 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c4465e1b-08ce-4b61-9b9f-15e762844b71 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:03.394159 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c4465e1b-08ce-4b61-9b9f-15e762844b71 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:03.394772 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c4465e1b-08ce-4b61-9b9f-15e762844b71 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:03.395324 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c4465e1b-08ce-4b61-9b9f-15e762844b71 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:03.412875 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9d71a8ae-44c3-4bed-89fa-2e21b280d5a4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:03.413664 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9d71a8ae-44c3-4bed-89fa-2e21b280d5a4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:03.422818 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d71a8ae-44c3-4bed-89fa-2e21b280d5a4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:03.424415 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d71a8ae-44c3-4bed-89fa-2e21b280d5a4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:03.426104 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d71a8ae-44c3-4bed-89fa-2e21b280d5a4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:03.427039 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d71a8ae-44c3-4bed-89fa-2e21b280d5a4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:03.427805 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d71a8ae-44c3-4bed-89fa-2e21b280d5a4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:03.428544 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d71a8ae-44c3-4bed-89fa-2e21b280d5a4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:03.537181 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9d71a8ae-44c3-4bed-89fa-2e21b280d5a4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134342 Aug 26 18:26:03.538105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 202/394] 10.222.0.45 () {58 vars in 1275 bytes} [Fri Aug 26 18:26:03 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:26:03.651074 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c4465e1b-08ce-4b61-9b9f-15e762844b71 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:03.672148 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aa76d47d-e2ae-43c6-84a7-b9fd1a1b9152 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:03.673669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aa76d47d-e2ae-43c6-84a7-b9fd1a1b9152 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:03.684616 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa76d47d-e2ae-43c6-84a7-b9fd1a1b9152 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:03.685153 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa76d47d-e2ae-43c6-84a7-b9fd1a1b9152 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:03.685707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa76d47d-e2ae-43c6-84a7-b9fd1a1b9152 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:03.686438 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa76d47d-e2ae-43c6-84a7-b9fd1a1b9152 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:03.686893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa76d47d-e2ae-43c6-84a7-b9fd1a1b9152 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:03.687319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa76d47d-e2ae-43c6-84a7-b9fd1a1b9152 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:03.709636 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c4465e1b-08ce-4b61-9b9f-15e762844b71 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:03.711401 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c4465e1b-08ce-4b61-9b9f-15e762844b71 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:03.717882 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c4465e1b-08ce-4b61-9b9f-15e762844b71 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1740 microversion: 2.20 time: 0.363285 Aug 26 18:26:03.719275 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 193/395] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:03 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1740 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:26:03.733464 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:03.892372 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-fb2f329e-ff03-4ee8-880e-345a40a9e6b8 req-1028572f-d320-4c88-aa31-d5dc688e8ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12257499-71a4-46e5-9264-9e2f3a407939", "name": "network-vif-plugged", "status": "completed", "tag": "727e4962-72eb-4dc3-8254-9668facff5d6"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:03.911848 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-fb2f329e-ff03-4ee8-880e-345a40a9e6b8 req-1028572f-d320-4c88-aa31-d5dc688e8ae7 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:03.912797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-fb2f329e-ff03-4ee8-880e-345a40a9e6b8 req-1028572f-d320-4c88-aa31-d5dc688e8ae7 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:03.913498 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-fb2f329e-ff03-4ee8-880e-345a40a9e6b8 req-1028572f-d320-4c88-aa31-d5dc688e8ae7 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:03.926800 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-fb2f329e-ff03-4ee8-880e-345a40a9e6b8 req-1028572f-d320-4c88-aa31-d5dc688e8ae7 service nova] Creating event network-vif-plugged:727e4962-72eb-4dc3-8254-9668facff5d6 for instance 12257499-71a4-46e5-9264-9e2f3a407939 on hv-cinder-85199 Aug 26 18:26:03.932653 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-fb2f329e-ff03-4ee8-880e-345a40a9e6b8 req-1028572f-d320-4c88-aa31-d5dc688e8ae7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044817 Aug 26 18:26:03.933646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 194/396] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:26:03.950538 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7434d490-71d1-4936-9cf2-9bad42520864 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:03.951818 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-7434d490-71d1-4936-9cf2-9bad42520864 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:03.958979 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7434d490-71d1-4936-9cf2-9bad42520864 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:03.959704 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7434d490-71d1-4936-9cf2-9bad42520864 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:03.960695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7434d490-71d1-4936-9cf2-9bad42520864 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:03.961919 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7434d490-71d1-4936-9cf2-9bad42520864 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:03.962652 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7434d490-71d1-4936-9cf2-9bad42520864 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:03.963300 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7434d490-71d1-4936-9cf2-9bad42520864 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:04.000822 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-aa76d47d-e2ae-43c6-84a7-b9fd1a1b9152 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:04.008879 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aa76d47d-e2ae-43c6-84a7-b9fd1a1b9152 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1315 microversion: 2.1 time: 0.350068 Aug 26 18:26:04.021128 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 203/397] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:03 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:04.042749 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-063199d0-e929-461d-89c8-569a40457012 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:04.043375 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-063199d0-e929-461d-89c8-569a40457012 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:04.052847 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-063199d0-e929-461d-89c8-569a40457012 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:04.053337 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-063199d0-e929-461d-89c8-569a40457012 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:04.053774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-063199d0-e929-461d-89c8-569a40457012 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:04.054480 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-063199d0-e929-461d-89c8-569a40457012 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:04.054934 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-063199d0-e929-461d-89c8-569a40457012 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:04.055546 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-063199d0-e929-461d-89c8-569a40457012 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:04.289572 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-7434d490-71d1-4936-9cf2-9bad42520864 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:04.300772 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-7434d490-71d1-4936-9cf2-9bad42520864 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1267 microversion: 2.1 time: 0.354310 Aug 26 18:26:04.305592 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 195/398] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:03 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1267 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:04.743555 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-155dd8b9-dc22-49de-b7cf-d5a717d2563b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:04.745014 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-155dd8b9-dc22-49de-b7cf-d5a717d2563b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:04.762150 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-155dd8b9-dc22-49de-b7cf-d5a717d2563b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:04.769143 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-155dd8b9-dc22-49de-b7cf-d5a717d2563b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:04.769586 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-155dd8b9-dc22-49de-b7cf-d5a717d2563b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:04.770320 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-155dd8b9-dc22-49de-b7cf-d5a717d2563b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:04.770770 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-155dd8b9-dc22-49de-b7cf-d5a717d2563b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:04.771197 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-155dd8b9-dc22-49de-b7cf-d5a717d2563b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:05.022866 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:05.042364 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-063199d0-e929-461d-89c8-569a40457012 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:05.046153 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=10 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:05.062258 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-063199d0-e929-461d-89c8-569a40457012 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 1.023462 Aug 26 18:26:05.071378 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 204/399] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:04 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:26:05.077057 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-155dd8b9-dc22-49de-b7cf-d5a717d2563b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:05.079228 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ee7308be-80e8-4d2d-a96e-f65acbee9df8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:05.079851 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ee7308be-80e8-4d2d-a96e-f65acbee9df8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:05.086527 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-155dd8b9-dc22-49de-b7cf-d5a717d2563b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:05.088059 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-155dd8b9-dc22-49de-b7cf-d5a717d2563b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:05.089302 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-155dd8b9-dc22-49de-b7cf-d5a717d2563b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1740 microversion: 2.20 time: 0.351191 Aug 26 18:26:05.100772 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 196/400] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:04 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1740 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:05.100996 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee7308be-80e8-4d2d-a96e-f65acbee9df8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:05.103698 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee7308be-80e8-4d2d-a96e-f65acbee9df8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:05.104165 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee7308be-80e8-4d2d-a96e-f65acbee9df8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:05.104931 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee7308be-80e8-4d2d-a96e-f65acbee9df8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:05.105389 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee7308be-80e8-4d2d-a96e-f65acbee9df8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:05.105821 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee7308be-80e8-4d2d-a96e-f65acbee9df8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:05.323557 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f206f69e-73fa-4599-be6e-3b83b00b15a9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:05.324984 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f206f69e-73fa-4599-be6e-3b83b00b15a9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:05.342960 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f206f69e-73fa-4599-be6e-3b83b00b15a9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:05.343829 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f206f69e-73fa-4599-be6e-3b83b00b15a9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:05.345272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f206f69e-73fa-4599-be6e-3b83b00b15a9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:05.346211 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f206f69e-73fa-4599-be6e-3b83b00b15a9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:05.346817 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f206f69e-73fa-4599-be6e-3b83b00b15a9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:05.347560 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f206f69e-73fa-4599-be6e-3b83b00b15a9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:05.387641 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ee7308be-80e8-4d2d-a96e-f65acbee9df8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:05.405999 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ee7308be-80e8-4d2d-a96e-f65acbee9df8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1315 microversion: 2.1 time: 0.333380 Aug 26 18:26:05.418845 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 205/401] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:05 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:05.649066 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f206f69e-73fa-4599-be6e-3b83b00b15a9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:05.664406 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f206f69e-73fa-4599-be6e-3b83b00b15a9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1267 microversion: 2.1 time: 0.343055 Aug 26 18:26:05.667301 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 197/402] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:05 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1267 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:05.833236 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-02d8cd8b-255e-4d87-8491-ba196fd21f26 req-eadd87af-47cb-4076-81ca-c2f6042d8d7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64b399c3-d3a3-4193-9826-e509b3b9b529", "tag": "b0c5500f-b975-4591-a361-36f0917bc440"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:05.842341 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=18 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:05.845175 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-02d8cd8b-255e-4d87-8491-ba196fd21f26 req-eadd87af-47cb-4076-81ca-c2f6042d8d7d service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:05.845931 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-02d8cd8b-255e-4d87-8491-ba196fd21f26 req-eadd87af-47cb-4076-81ca-c2f6042d8d7d service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:05.846634 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-02d8cd8b-255e-4d87-8491-ba196fd21f26 req-eadd87af-47cb-4076-81ca-c2f6042d8d7d service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:05.866192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-02d8cd8b-255e-4d87-8491-ba196fd21f26 req-eadd87af-47cb-4076-81ca-c2f6042d8d7d service nova] Creating event network-changed:b0c5500f-b975-4591-a361-36f0917bc440 for instance 64b399c3-d3a3-4193-9826-e509b3b9b529 on hv-cinder-85199 Aug 26 18:26:05.881614 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-02d8cd8b-255e-4d87-8491-ba196fd21f26 req-eadd87af-47cb-4076-81ca-c2f6042d8d7d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051889 Aug 26 18:26:05.886461 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 206/403] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:26:06.092407 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-915e525b-7c79-4573-9fc6-40be57c06934 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:06.093294 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-915e525b-7c79-4573-9fc6-40be57c06934 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:06.101100 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-915e525b-7c79-4573-9fc6-40be57c06934 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:06.101872 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-915e525b-7c79-4573-9fc6-40be57c06934 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:06.102309 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-915e525b-7c79-4573-9fc6-40be57c06934 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:06.103015 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-915e525b-7c79-4573-9fc6-40be57c06934 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:06.104262 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-915e525b-7c79-4573-9fc6-40be57c06934 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:06.104695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-915e525b-7c79-4573-9fc6-40be57c06934 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:06.119502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-febeece6-7592-4b82-b18a-e044a987233a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:06.120216 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-febeece6-7592-4b82-b18a-e044a987233a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:06.163403 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-febeece6-7592-4b82-b18a-e044a987233a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:06.165142 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-febeece6-7592-4b82-b18a-e044a987233a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:06.166214 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-febeece6-7592-4b82-b18a-e044a987233a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:06.167071 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-febeece6-7592-4b82-b18a-e044a987233a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:06.167533 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-febeece6-7592-4b82-b18a-e044a987233a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:06.167957 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-febeece6-7592-4b82-b18a-e044a987233a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:06.487946 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-febeece6-7592-4b82-b18a-e044a987233a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:06.508991 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-febeece6-7592-4b82-b18a-e044a987233a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:06.510851 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-febeece6-7592-4b82-b18a-e044a987233a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:06.512089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-febeece6-7592-4b82-b18a-e044a987233a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1740 microversion: 2.20 time: 0.401391 Aug 26 18:26:06.527875 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 207/404] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:06 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1740 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:06.528666 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-786b1bc5-ee85-46cd-a48a-b0d993081d51 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:06.529261 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-786b1bc5-ee85-46cd-a48a-b0d993081d51 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:06.546838 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-786b1bc5-ee85-46cd-a48a-b0d993081d51 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:06.553215 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-786b1bc5-ee85-46cd-a48a-b0d993081d51 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:06.554042 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-786b1bc5-ee85-46cd-a48a-b0d993081d51 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:06.557130 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-786b1bc5-ee85-46cd-a48a-b0d993081d51 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:06.557610 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-786b1bc5-ee85-46cd-a48a-b0d993081d51 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:06.558063 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-786b1bc5-ee85-46cd-a48a-b0d993081d51 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:06.634414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-915e525b-7c79-4573-9fc6-40be57c06934 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:06.644986 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-915e525b-7c79-4573-9fc6-40be57c06934 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.561417 Aug 26 18:26:06.660376 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 198/405] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:06 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:06.691177 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-768f4bce-d3d5-40b7-9831-c943cf3787ee tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:06.692084 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-768f4bce-d3d5-40b7-9831-c943cf3787ee tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:06.707306 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-768f4bce-d3d5-40b7-9831-c943cf3787ee tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:06.708134 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-768f4bce-d3d5-40b7-9831-c943cf3787ee tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:06.708735 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-768f4bce-d3d5-40b7-9831-c943cf3787ee tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:06.710141 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-768f4bce-d3d5-40b7-9831-c943cf3787ee tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:06.711400 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-768f4bce-d3d5-40b7-9831-c943cf3787ee tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:06.711996 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-768f4bce-d3d5-40b7-9831-c943cf3787ee tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:06.831804 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-786b1bc5-ee85-46cd-a48a-b0d993081d51 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:06.846147 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-786b1bc5-ee85-46cd-a48a-b0d993081d51 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1465 microversion: 2.1 time: 0.323151 Aug 26 18:26:06.847083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 208/406] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:06 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1465 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:06.923638 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-593c40e0-0fa6-42af-8e09-f10b07ec6990 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:06.924652 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-593c40e0-0fa6-42af-8e09-f10b07ec6990 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:06.933072 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-593c40e0-0fa6-42af-8e09-f10b07ec6990 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:06.933568 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-593c40e0-0fa6-42af-8e09-f10b07ec6990 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:06.947162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-593c40e0-0fa6-42af-8e09-f10b07ec6990 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:06.948214 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-593c40e0-0fa6-42af-8e09-f10b07ec6990 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:06.950911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-593c40e0-0fa6-42af-8e09-f10b07ec6990 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:06.951397 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-593c40e0-0fa6-42af-8e09-f10b07ec6990 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:07.112175 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-593c40e0-0fa6-42af-8e09-f10b07ec6990 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:26:07.191747 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-768f4bce-d3d5-40b7-9831-c943cf3787ee tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:07.199739 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-768f4bce-d3d5-40b7-9831-c943cf3787ee tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1267 microversion: 2.1 time: 0.513021 Aug 26 18:26:07.200518 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 199/407] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:06 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1267 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:07.326092 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-593c40e0-0fa6-42af-8e09-f10b07ec6990 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "DELETE /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 204 len: 0 microversion: 2.1 time: 0.406257 Aug 26 18:26:07.327617 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 209/408] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:26:06 2022] DELETE /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 18:26:07.335638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-25fc003f-dde3-4b77-bca0-a8bbcdbf6a3a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:07.336233 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-25fc003f-dde3-4b77-bca0-a8bbcdbf6a3a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:07.348905 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-25fc003f-dde3-4b77-bca0-a8bbcdbf6a3a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:07.349488 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-25fc003f-dde3-4b77-bca0-a8bbcdbf6a3a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:07.350343 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-25fc003f-dde3-4b77-bca0-a8bbcdbf6a3a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:07.350818 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-25fc003f-dde3-4b77-bca0-a8bbcdbf6a3a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:07.353174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-25fc003f-dde3-4b77-bca0-a8bbcdbf6a3a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:07.353765 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-25fc003f-dde3-4b77-bca0-a8bbcdbf6a3a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:07.536263 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8afdecc8-5922-48d1-bffe-0a4e049bae2b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:07.537025 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8afdecc8-5922-48d1-bffe-0a4e049bae2b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:07.543117 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8afdecc8-5922-48d1-bffe-0a4e049bae2b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:07.543617 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8afdecc8-5922-48d1-bffe-0a4e049bae2b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:07.544054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8afdecc8-5922-48d1-bffe-0a4e049bae2b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:07.544818 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8afdecc8-5922-48d1-bffe-0a4e049bae2b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:07.545361 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8afdecc8-5922-48d1-bffe-0a4e049bae2b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:07.545791 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8afdecc8-5922-48d1-bffe-0a4e049bae2b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:07.590308 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-25fc003f-dde3-4b77-bca0-a8bbcdbf6a3a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:07.601354 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-25fc003f-dde3-4b77-bca0-a8bbcdbf6a3a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1471 microversion: 2.1 time: 0.269571 Aug 26 18:26:07.603857 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 200/409] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:07 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1471 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:07.669739 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-42f006c9-e278-46b8-9a38-e01d63b0fb7c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:07.670544 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-42f006c9-e278-46b8-9a38-e01d63b0fb7c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:07.684318 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-42f006c9-e278-46b8-9a38-e01d63b0fb7c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:07.686187 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-42f006c9-e278-46b8-9a38-e01d63b0fb7c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:07.688569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-42f006c9-e278-46b8-9a38-e01d63b0fb7c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:07.689644 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-42f006c9-e278-46b8-9a38-e01d63b0fb7c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:07.690731 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-42f006c9-e278-46b8-9a38-e01d63b0fb7c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:07.692593 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-42f006c9-e278-46b8-9a38-e01d63b0fb7c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:07.807473 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8afdecc8-5922-48d1-bffe-0a4e049bae2b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:07.816337 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8afdecc8-5922-48d1-bffe-0a4e049bae2b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:07.823033 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8afdecc8-5922-48d1-bffe-0a4e049bae2b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:07.828458 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8afdecc8-5922-48d1-bffe-0a4e049bae2b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1740 microversion: 2.20 time: 0.296584 Aug 26 18:26:07.832749 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 210/410] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:07 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:26:08.126580 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-42f006c9-e278-46b8-9a38-e01d63b0fb7c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:08.142270 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-42f006c9-e278-46b8-9a38-e01d63b0fb7c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.477736 Aug 26 18:26:08.153101 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 201/411] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:07 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:08.220652 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-883d0550-3409-4ab8-97e7-919cfa6ef2d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:08.221298 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-883d0550-3409-4ab8-97e7-919cfa6ef2d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:08.231988 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-883d0550-3409-4ab8-97e7-919cfa6ef2d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:08.232860 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-883d0550-3409-4ab8-97e7-919cfa6ef2d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:08.233606 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-883d0550-3409-4ab8-97e7-919cfa6ef2d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:08.234568 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-883d0550-3409-4ab8-97e7-919cfa6ef2d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:08.235235 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-883d0550-3409-4ab8-97e7-919cfa6ef2d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:08.235854 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-883d0550-3409-4ab8-97e7-919cfa6ef2d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:08.413443 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-883d0550-3409-4ab8-97e7-919cfa6ef2d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:08.422701 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-883d0550-3409-4ab8-97e7-919cfa6ef2d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1267 microversion: 2.1 time: 0.206917 Aug 26 18:26:08.435886 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 211/412] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:08 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:08.624254 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1cc26814-8042-4d5b-9b29-94f8a18a622c tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:08.625239 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1cc26814-8042-4d5b-9b29-94f8a18a622c tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:08.641082 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1cc26814-8042-4d5b-9b29-94f8a18a622c tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:08.642038 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1cc26814-8042-4d5b-9b29-94f8a18a622c tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:08.642714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1cc26814-8042-4d5b-9b29-94f8a18a622c tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:08.643947 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1cc26814-8042-4d5b-9b29-94f8a18a622c tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:08.644617 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1cc26814-8042-4d5b-9b29-94f8a18a622c tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:08.645271 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1cc26814-8042-4d5b-9b29-94f8a18a622c tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:08.856483 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1cc26814-8042-4d5b-9b29-94f8a18a622c tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:08.870161 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1cc26814-8042-4d5b-9b29-94f8a18a622c tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1471 microversion: 2.1 time: 0.250294 Aug 26 18:26:08.871406 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 202/413] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:08 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1471 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:08.925557 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7cd12074-a10f-472f-92be-774606624cfd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:08.926548 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7cd12074-a10f-472f-92be-774606624cfd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:08.943337 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cd12074-a10f-472f-92be-774606624cfd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:08.944419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cd12074-a10f-472f-92be-774606624cfd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:08.945041 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cd12074-a10f-472f-92be-774606624cfd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:08.945936 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cd12074-a10f-472f-92be-774606624cfd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:08.946617 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cd12074-a10f-472f-92be-774606624cfd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:08.947192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cd12074-a10f-472f-92be-774606624cfd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:09.146509 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7cd12074-a10f-472f-92be-774606624cfd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:09.156900 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7cd12074-a10f-472f-92be-774606624cfd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:09.159515 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7cd12074-a10f-472f-92be-774606624cfd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:09.160970 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7cd12074-a10f-472f-92be-774606624cfd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1740 microversion: 2.20 time: 0.245339 Aug 26 18:26:09.162080 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 212/414] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:08 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:26:09.164645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2515fbab-6c9c-4fbb-90af-7d4c4ebee827 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:09.165201 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2515fbab-6c9c-4fbb-90af-7d4c4ebee827 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:09.181600 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2515fbab-6c9c-4fbb-90af-7d4c4ebee827 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:09.182019 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2515fbab-6c9c-4fbb-90af-7d4c4ebee827 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:09.182462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2515fbab-6c9c-4fbb-90af-7d4c4ebee827 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:09.183177 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2515fbab-6c9c-4fbb-90af-7d4c4ebee827 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:09.183631 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2515fbab-6c9c-4fbb-90af-7d4c4ebee827 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:09.184050 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2515fbab-6c9c-4fbb-90af-7d4c4ebee827 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:09.336590 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2515fbab-6c9c-4fbb-90af-7d4c4ebee827 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:09.346320 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2515fbab-6c9c-4fbb-90af-7d4c4ebee827 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1725 microversion: 2.1 time: 0.185570 Aug 26 18:26:09.347282 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 203/415] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:09 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:09.444375 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3a44654d-21ae-4b49-a0bb-88c2014066fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:09.444986 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3a44654d-21ae-4b49-a0bb-88c2014066fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:09.452235 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a44654d-21ae-4b49-a0bb-88c2014066fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:09.452750 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a44654d-21ae-4b49-a0bb-88c2014066fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:09.453183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a44654d-21ae-4b49-a0bb-88c2014066fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:09.454053 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a44654d-21ae-4b49-a0bb-88c2014066fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:09.454610 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a44654d-21ae-4b49-a0bb-88c2014066fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:09.455038 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a44654d-21ae-4b49-a0bb-88c2014066fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:09.775382 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3a44654d-21ae-4b49-a0bb-88c2014066fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:09.784609 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3a44654d-21ae-4b49-a0bb-88c2014066fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1267 microversion: 2.1 time: 0.344894 Aug 26 18:26:09.791474 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 213/416] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:09 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1267 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:09.891629 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-3e846c57-1544-4b99-b096-2dfcf7621ef8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:09.893490 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-3e846c57-1544-4b99-b096-2dfcf7621ef8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:09.900704 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3e846c57-1544-4b99-b096-2dfcf7621ef8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:09.901547 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3e846c57-1544-4b99-b096-2dfcf7621ef8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:09.902199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3e846c57-1544-4b99-b096-2dfcf7621ef8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:09.903139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3e846c57-1544-4b99-b096-2dfcf7621ef8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:09.903822 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3e846c57-1544-4b99-b096-2dfcf7621ef8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:09.904590 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3e846c57-1544-4b99-b096-2dfcf7621ef8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:10.081833 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3e846c57-1544-4b99-b096-2dfcf7621ef8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:10.092700 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-3e846c57-1544-4b99-b096-2dfcf7621ef8 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1471 microversion: 2.1 time: 0.204240 Aug 26 18:26:10.093934 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 204/417] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:09 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:10.191617 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-972fdcc7-1347-4dde-98d0-e4eaf9924658 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:10.192877 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-972fdcc7-1347-4dde-98d0-e4eaf9924658 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:10.205244 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-972fdcc7-1347-4dde-98d0-e4eaf9924658 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:10.206030 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-972fdcc7-1347-4dde-98d0-e4eaf9924658 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:10.206632 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-972fdcc7-1347-4dde-98d0-e4eaf9924658 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:10.207831 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-972fdcc7-1347-4dde-98d0-e4eaf9924658 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:10.211966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-972fdcc7-1347-4dde-98d0-e4eaf9924658 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:10.212934 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-972fdcc7-1347-4dde-98d0-e4eaf9924658 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:10.371773 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0ae8d350-a523-4c16-8b48-23eb1d1a73b1 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:10.372399 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-0ae8d350-a523-4c16-8b48-23eb1d1a73b1 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:10.382618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0ae8d350-a523-4c16-8b48-23eb1d1a73b1 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:10.383114 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0ae8d350-a523-4c16-8b48-23eb1d1a73b1 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:10.387045 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0ae8d350-a523-4c16-8b48-23eb1d1a73b1 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:10.393755 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0ae8d350-a523-4c16-8b48-23eb1d1a73b1 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:10.394245 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0ae8d350-a523-4c16-8b48-23eb1d1a73b1 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:10.394680 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0ae8d350-a523-4c16-8b48-23eb1d1a73b1 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:10.402336 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-972fdcc7-1347-4dde-98d0-e4eaf9924658 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:10.413860 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-972fdcc7-1347-4dde-98d0-e4eaf9924658 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:10.415504 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-972fdcc7-1347-4dde-98d0-e4eaf9924658 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:10.417367 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-972fdcc7-1347-4dde-98d0-e4eaf9924658 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1740 microversion: 2.20 time: 0.230376 Aug 26 18:26:10.418436 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 214/418] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:10 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:10.807370 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8ecc0b8f-5371-4a9f-87c5-cbba7f38e7fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:10.808127 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8ecc0b8f-5371-4a9f-87c5-cbba7f38e7fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:10.820468 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ecc0b8f-5371-4a9f-87c5-cbba7f38e7fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:10.825492 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0ae8d350-a523-4c16-8b48-23eb1d1a73b1 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:10.829866 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ecc0b8f-5371-4a9f-87c5-cbba7f38e7fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:10.835193 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-0ae8d350-a523-4c16-8b48-23eb1d1a73b1 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1702 microversion: 2.1 time: 0.467779 Aug 26 18:26:10.836770 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ecc0b8f-5371-4a9f-87c5-cbba7f38e7fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:10.838395 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ecc0b8f-5371-4a9f-87c5-cbba7f38e7fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:10.843285 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ecc0b8f-5371-4a9f-87c5-cbba7f38e7fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:10.859019 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 205/419] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:10 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1702 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:10.860733 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ecc0b8f-5371-4a9f-87c5-cbba7f38e7fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:10.864490 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c165f251-efe8-48b1-9413-70b350efa793 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:10.871287 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c165f251-efe8-48b1-9413-70b350efa793 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:10.871927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c165f251-efe8-48b1-9413-70b350efa793 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:10.872449 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c165f251-efe8-48b1-9413-70b350efa793 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:10.953638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c165f251-efe8-48b1-9413-70b350efa793 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Going to try to start instance {{(pid=120540) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 18:26:11.010691 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c165f251-efe8-48b1-9413-70b350efa793 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "POST /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/action" status: 202 len: 0 microversion: 2.1 time: 0.149282 Aug 26 18:26:11.012286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 206/420] 10.222.0.45 () {60 vars in 1278 bytes} [Fri Aug 26 18:26:10 2022] POST /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:26:11.027613 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-33802262-dffd-4df2-9d14-6a09963d44b0 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:11.030111 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-33802262-dffd-4df2-9d14-6a09963d44b0 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:11.042347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-33802262-dffd-4df2-9d14-6a09963d44b0 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:11.046809 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-33802262-dffd-4df2-9d14-6a09963d44b0 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:11.047340 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-33802262-dffd-4df2-9d14-6a09963d44b0 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:11.048148 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-33802262-dffd-4df2-9d14-6a09963d44b0 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:11.049207 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-33802262-dffd-4df2-9d14-6a09963d44b0 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:11.054767 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-33802262-dffd-4df2-9d14-6a09963d44b0 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:11.264004 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8ecc0b8f-5371-4a9f-87c5-cbba7f38e7fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:11.272913 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8ecc0b8f-5371-4a9f-87c5-cbba7f38e7fa tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1267 microversion: 2.1 time: 0.469303 Aug 26 18:26:11.285792 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 215/421] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:10 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1267 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:26:11.287081 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4911cb54-3838-451a-a01c-0aa754872f69 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:11.287714 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4911cb54-3838-451a-a01c-0aa754872f69 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:11.298610 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4911cb54-3838-451a-a01c-0aa754872f69 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:11.299088 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4911cb54-3838-451a-a01c-0aa754872f69 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:11.300399 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4911cb54-3838-451a-a01c-0aa754872f69 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:11.301140 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4911cb54-3838-451a-a01c-0aa754872f69 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:11.301585 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4911cb54-3838-451a-a01c-0aa754872f69 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:11.302006 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4911cb54-3838-451a-a01c-0aa754872f69 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:11.351756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-33802262-dffd-4df2-9d14-6a09963d44b0 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:11.360851 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-33802262-dffd-4df2-9d14-6a09963d44b0 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1711 microversion: 2.1 time: 0.342044 Aug 26 18:26:11.367938 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 207/422] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:11 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1711 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:11.447602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-fdc91ae8-5d70-4eb0-affb-a20988ded65b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:11.448307 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-fdc91ae8-5d70-4eb0-affb-a20988ded65b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:11.463699 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdc91ae8-5d70-4eb0-affb-a20988ded65b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:11.466581 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdc91ae8-5d70-4eb0-affb-a20988ded65b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:11.467155 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdc91ae8-5d70-4eb0-affb-a20988ded65b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:11.467995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdc91ae8-5d70-4eb0-affb-a20988ded65b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:11.470597 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdc91ae8-5d70-4eb0-affb-a20988ded65b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:11.471134 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdc91ae8-5d70-4eb0-affb-a20988ded65b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:11.475918 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:11.513562 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4911cb54-3838-451a-a01c-0aa754872f69 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:11.530147 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4911cb54-3838-451a-a01c-0aa754872f69 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1471 microversion: 2.1 time: 0.251913 Aug 26 18:26:11.534302 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 216/423] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:11 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:11.786533 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-d0b0a13c-e97f-44f0-aec3-259bff16af7c req-b2a16e64-7a0b-48cc-91a9-23a66c354aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12257499-71a4-46e5-9264-9e2f3a407939", "name": "network-vif-deleted", "tag": "727e4962-72eb-4dc3-8254-9668facff5d6"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:11.802534 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d0b0a13c-e97f-44f0-aec3-259bff16af7c req-b2a16e64-7a0b-48cc-91a9-23a66c354aa3 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:11.807793 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d0b0a13c-e97f-44f0-aec3-259bff16af7c req-b2a16e64-7a0b-48cc-91a9-23a66c354aa3 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:11.808383 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d0b0a13c-e97f-44f0-aec3-259bff16af7c req-b2a16e64-7a0b-48cc-91a9-23a66c354aa3 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:11.837749 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-d0b0a13c-e97f-44f0-aec3-259bff16af7c req-b2a16e64-7a0b-48cc-91a9-23a66c354aa3 service nova] Creating event network-vif-deleted:727e4962-72eb-4dc3-8254-9668facff5d6 for instance 12257499-71a4-46e5-9264-9e2f3a407939 on hv-cinder-85199 Aug 26 18:26:11.850671 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-d0b0a13c-e97f-44f0-aec3-259bff16af7c req-b2a16e64-7a0b-48cc-91a9-23a66c354aa3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068072 Aug 26 18:26:11.852972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 217/424] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:26:12.070752 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-fdc91ae8-5d70-4eb0-affb-a20988ded65b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:12.087369 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-fdc91ae8-5d70-4eb0-affb-a20988ded65b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:12.093003 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-fdc91ae8-5d70-4eb0-affb-a20988ded65b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:12.095640 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-fdc91ae8-5d70-4eb0-affb-a20988ded65b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1740 microversion: 2.20 time: 0.652189 Aug 26 18:26:12.114679 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 208/425] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:11 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1740 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:12.320234 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-31d30e37-a9fb-4458-a72d-11c781ef50ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:12.333705 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-31d30e37-a9fb-4458-a72d-11c781ef50ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:12.333860 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31d30e37-a9fb-4458-a72d-11c781ef50ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:12.334321 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31d30e37-a9fb-4458-a72d-11c781ef50ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:12.334753 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31d30e37-a9fb-4458-a72d-11c781ef50ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:12.335467 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31d30e37-a9fb-4458-a72d-11c781ef50ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:12.335913 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31d30e37-a9fb-4458-a72d-11c781ef50ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:12.336329 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31d30e37-a9fb-4458-a72d-11c781ef50ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:12.390222 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-cdba3f54-23bc-43a0-90cc-c78a3d8e3ce5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:12.391530 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-cdba3f54-23bc-43a0-90cc-c78a3d8e3ce5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:12.408956 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cdba3f54-23bc-43a0-90cc-c78a3d8e3ce5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:12.409526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cdba3f54-23bc-43a0-90cc-c78a3d8e3ce5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:12.410024 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cdba3f54-23bc-43a0-90cc-c78a3d8e3ce5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:12.410774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cdba3f54-23bc-43a0-90cc-c78a3d8e3ce5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:12.412445 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cdba3f54-23bc-43a0-90cc-c78a3d8e3ce5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:12.413214 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cdba3f54-23bc-43a0-90cc-c78a3d8e3ce5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:12.653810 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-cdba3f54-23bc-43a0-90cc-c78a3d8e3ce5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:12.662977 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-31d30e37-a9fb-4458-a72d-11c781ef50ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:12.665569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-cdba3f54-23bc-43a0-90cc-c78a3d8e3ce5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1711 microversion: 2.1 time: 0.279691 Aug 26 18:26:12.666166 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 209/426] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:12 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1711 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:12.670933 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-b3feb22b-e500-4f1d-9a03-c104926fec89 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:12.671548 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-b3feb22b-e500-4f1d-9a03-c104926fec89 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:12.677764 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3feb22b-e500-4f1d-9a03-c104926fec89 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:12.678238 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3feb22b-e500-4f1d-9a03-c104926fec89 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:12.678656 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3feb22b-e500-4f1d-9a03-c104926fec89 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:12.679515 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3feb22b-e500-4f1d-9a03-c104926fec89 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:12.680127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3feb22b-e500-4f1d-9a03-c104926fec89 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:12.680689 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3feb22b-e500-4f1d-9a03-c104926fec89 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:12.686950 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-31d30e37-a9fb-4458-a72d-11c781ef50ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1267 microversion: 2.1 time: 0.396339 Aug 26 18:26:12.688085 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 218/427] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:12 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1267 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:12.743586 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3feb22b-e500-4f1d-9a03-c104926fec89 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:12.744345 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3feb22b-e500-4f1d-9a03-c104926fec89 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:12.744957 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3feb22b-e500-4f1d-9a03-c104926fec89 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:12.745632 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-b3feb22b-e500-4f1d-9a03-c104926fec89 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lazy-loading 'fault' on Instance uuid 12257499-71a4-46e5-9264-9e2f3a407939 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:26:12.813532 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b3feb22b-e500-4f1d-9a03-c104926fec89 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c70c266fe3a46ebad73127c1f1e5c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b7e87f26c6748f3a55767285de31cde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:12.822172 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-b3feb22b-e500-4f1d-9a03-c104926fec89 tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 200 len: 1305 microversion: 2.1 time: 0.154891 Aug 26 18:26:12.833542 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 210/428] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:12 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 1305 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:13.125727 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4000b632-773f-4f1c-909a-3ca5c4a7e170 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:13.126997 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4000b632-773f-4f1c-909a-3ca5c4a7e170 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:13.147434 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4000b632-773f-4f1c-909a-3ca5c4a7e170 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:13.148224 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4000b632-773f-4f1c-909a-3ca5c4a7e170 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:13.148873 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4000b632-773f-4f1c-909a-3ca5c4a7e170 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:13.149750 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4000b632-773f-4f1c-909a-3ca5c4a7e170 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:13.150363 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4000b632-773f-4f1c-909a-3ca5c4a7e170 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:13.150968 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4000b632-773f-4f1c-909a-3ca5c4a7e170 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:13.363042 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4000b632-773f-4f1c-909a-3ca5c4a7e170 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:13.368685 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:13.381791 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4000b632-773f-4f1c-909a-3ca5c4a7e170 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:13.386699 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4000b632-773f-4f1c-909a-3ca5c4a7e170 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:13.389952 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4000b632-773f-4f1c-909a-3ca5c4a7e170 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1740 microversion: 2.20 time: 0.268791 Aug 26 18:26:13.390324 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 219/429] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:13 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:13.700474 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-de751556-5ce9-42a8-a18b-e2bff726dc3f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:13.718925 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-de751556-5ce9-42a8-a18b-e2bff726dc3f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:13.719470 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4dcfdb9d-5c39-42be-a071-80867940b068 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:13.721001 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4dcfdb9d-5c39-42be-a071-80867940b068 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:13.740465 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de751556-5ce9-42a8-a18b-e2bff726dc3f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:13.745743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de751556-5ce9-42a8-a18b-e2bff726dc3f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:13.746675 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de751556-5ce9-42a8-a18b-e2bff726dc3f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:13.749325 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dcfdb9d-5c39-42be-a071-80867940b068 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:13.749846 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de751556-5ce9-42a8-a18b-e2bff726dc3f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:13.750506 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de751556-5ce9-42a8-a18b-e2bff726dc3f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:13.750900 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de751556-5ce9-42a8-a18b-e2bff726dc3f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:13.752550 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dcfdb9d-5c39-42be-a071-80867940b068 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:13.752971 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dcfdb9d-5c39-42be-a071-80867940b068 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:13.753980 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dcfdb9d-5c39-42be-a071-80867940b068 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:13.754560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dcfdb9d-5c39-42be-a071-80867940b068 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:13.756838 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dcfdb9d-5c39-42be-a071-80867940b068 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:13.989111 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-de751556-5ce9-42a8-a18b-e2bff726dc3f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:13.999678 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-de751556-5ce9-42a8-a18b-e2bff726dc3f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1711 microversion: 2.1 time: 0.306341 Aug 26 18:26:14.000388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 211/430] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:13 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1711 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:14.006452 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2b385b46-533c-437a-a7d0-a969301f437a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:14.007133 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2b385b46-533c-437a-a7d0-a969301f437a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] [instance: 12257499-71a4-46e5-9264-9e2f3a407939] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:14.009063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:14.014211 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2b385b46-533c-437a-a7d0-a969301f437a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:14.014956 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2b385b46-533c-437a-a7d0-a969301f437a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:14.015579 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2b385b46-533c-437a-a7d0-a969301f437a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:14.016282 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2b385b46-533c-437a-a7d0-a969301f437a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:14.016758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2b385b46-533c-437a-a7d0-a969301f437a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:14.017174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2b385b46-533c-437a-a7d0-a969301f437a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:14.033071 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-2b385b46-533c-437a-a7d0-a969301f437a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] HTTP exception thrown: Instance 12257499-71a4-46e5-9264-9e2f3a407939 could not be found. Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2b385b46-533c-437a-a7d0-a969301f437a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Request method failure captured: Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 HTTP/1.1 Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCRAqW9e2HIajKy4o-ijap5E6mW6YoJVycwdAmZg8TG9THv4EJ_yEslWXm-0dDLyM9OPobI_gcR-McJV8jSrGSb_bX2ZsF1yZ4kBENUTMV3ux5wh9GzPijM0-7lt_laY9osU6dTKmUrpQJBeLkXIE9-kNlqz4buBmySvbXfhmepbg25k Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 1b7e87f26c6748f3a55767285de31cde Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-VolumesNegativeTest-512802459 Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:26:14.034733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:26:14.036063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1b7e87f26c6748f3a55767285de31cde", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b7e87f26c6748f3a55767285de31cde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b7e87f26c6748f3a55767285de31cde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1b7e87f26c6748f3a55767285de31cde"}]}] Aug 26 18:26:14.036063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-VolumesNegativeTest-512802459 Aug 26 18:26:14.036063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 1b7e87f26c6748f3a55767285de31cde Aug 26 18:26:14.036063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-VolumesNegativeTest-512802459 Aug 26 18:26:14.036063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-VolumesNegativeTest-512802459-project Aug 26 18:26:14.036063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:26:14.036063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:26:14.036063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: 0c70c266fe3a46ebad73127c1f1e5c61 Aug 26 18:26:14.036063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-VolumesNegativeTest-512802459-project Aug 26 18:26:14.036063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:26:14.036063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance 12257499-71a4-46e5-9264-9e2f3a407939 could not be found. Aug 26 18:26:14.036063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '12257499-71a4-46e5-9264-9e2f3a407939'} Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12257499-71a4-46e5-9264-9e2f3a407939 could not be found. Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:26:14.036901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12257499-71a4-46e5-9264-9e2f3a407939 could not be found. Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12257499-71a4-46e5-9264-9e2f3a407939 could not be found. Aug 26 18:26:14.038088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:26:14.039552 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2b385b46-533c-437a-a7d0-a969301f437a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] Returning 404 to user: Instance 12257499-71a4-46e5-9264-9e2f3a407939 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:26:14.039552 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2b385b46-533c-437a-a7d0-a969301f437a tempest-VolumesNegativeTest-512802459 tempest-VolumesNegativeTest-512802459-project] 10.222.0.45 "GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939" status: 404 len: 111 microversion: 2.1 time: 0.034148 Aug 26 18:26:14.039552 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 212/431] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:14 2022] GET /compute/v2.1/servers/12257499-71a4-46e5-9264-9e2f3a407939 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:26:14.045018 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4dcfdb9d-5c39-42be-a071-80867940b068 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:14.055836 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4dcfdb9d-5c39-42be-a071-80867940b068 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1267 microversion: 2.1 time: 0.348646 Aug 26 18:26:14.058243 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 220/432] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:13 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1267 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:14.412331 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c6365847-3d07-4603-b88f-d5775a6a57bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:14.412982 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c6365847-3d07-4603-b88f-d5775a6a57bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:14.420137 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6365847-3d07-4603-b88f-d5775a6a57bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:14.420657 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6365847-3d07-4603-b88f-d5775a6a57bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:14.422071 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6365847-3d07-4603-b88f-d5775a6a57bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:14.422677 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6365847-3d07-4603-b88f-d5775a6a57bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:14.423443 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6365847-3d07-4603-b88f-d5775a6a57bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:14.424033 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6365847-3d07-4603-b88f-d5775a6a57bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:14.616059 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c6365847-3d07-4603-b88f-d5775a6a57bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:14.625506 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c6365847-3d07-4603-b88f-d5775a6a57bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:14.627294 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c6365847-3d07-4603-b88f-d5775a6a57bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:14.629006 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c6365847-3d07-4603-b88f-d5775a6a57bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1740 microversion: 2.20 time: 0.220865 Aug 26 18:26:14.629851 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 213/433] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:14 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:26:15.021934 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3bde154c-f778-4b59-a033-192b324b9f98 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:15.022545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3bde154c-f778-4b59-a033-192b324b9f98 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:15.031790 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3bde154c-f778-4b59-a033-192b324b9f98 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:15.032283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3bde154c-f778-4b59-a033-192b324b9f98 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:15.032764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3bde154c-f778-4b59-a033-192b324b9f98 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:15.033446 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3bde154c-f778-4b59-a033-192b324b9f98 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:15.033900 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3bde154c-f778-4b59-a033-192b324b9f98 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:15.034323 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3bde154c-f778-4b59-a033-192b324b9f98 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:15.085953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-46a1e9be-8f8f-4b28-ae75-d8d15b538b7a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:15.086710 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-46a1e9be-8f8f-4b28-ae75-d8d15b538b7a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:15.102319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-46a1e9be-8f8f-4b28-ae75-d8d15b538b7a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:15.102991 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-46a1e9be-8f8f-4b28-ae75-d8d15b538b7a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:15.103508 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-46a1e9be-8f8f-4b28-ae75-d8d15b538b7a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:15.104829 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-46a1e9be-8f8f-4b28-ae75-d8d15b538b7a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:15.109086 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-46a1e9be-8f8f-4b28-ae75-d8d15b538b7a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:15.109731 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-46a1e9be-8f8f-4b28-ae75-d8d15b538b7a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:15.235756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3bde154c-f778-4b59-a033-192b324b9f98 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:15.245583 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3bde154c-f778-4b59-a033-192b324b9f98 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1715 microversion: 2.1 time: 0.227820 Aug 26 18:26:15.247791 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 221/434] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:15 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1715 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:15.342926 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-46a1e9be-8f8f-4b28-ae75-d8d15b538b7a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:15.359617 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-46a1e9be-8f8f-4b28-ae75-d8d15b538b7a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1267 microversion: 2.1 time: 0.284152 Aug 26 18:26:15.364054 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 214/435] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:15 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1267 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:15.538179 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-f07a661e-365f-409c-934f-772ab22ce81e req-ba4fd8f2-96c6-47a8-87d4-23486ad84422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570e7fd4-4295-4f3c-9d2a-02f704ea6100", "name": "network-vif-plugged", "status": "completed", "tag": "fa397c67-c193-42fd-b326-362149109be9"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:15.552882 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-f07a661e-365f-409c-934f-772ab22ce81e req-ba4fd8f2-96c6-47a8-87d4-23486ad84422 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:15.555536 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-f07a661e-365f-409c-934f-772ab22ce81e req-ba4fd8f2-96c6-47a8-87d4-23486ad84422 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:15.556152 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-f07a661e-365f-409c-934f-772ab22ce81e req-ba4fd8f2-96c6-47a8-87d4-23486ad84422 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:15.575805 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-f07a661e-365f-409c-934f-772ab22ce81e req-ba4fd8f2-96c6-47a8-87d4-23486ad84422 service nova] Creating event network-vif-plugged:fa397c67-c193-42fd-b326-362149109be9 for instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 on hv-cinder-85199 Aug 26 18:26:15.582844 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-f07a661e-365f-409c-934f-772ab22ce81e req-ba4fd8f2-96c6-47a8-87d4-23486ad84422 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047965 Aug 26 18:26:15.584691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 222/436] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:26:15.657852 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2847f277-dd49-4123-afb1-97704107f8ec tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:15.659333 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2847f277-dd49-4123-afb1-97704107f8ec tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:15.665582 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2847f277-dd49-4123-afb1-97704107f8ec tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:15.666268 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2847f277-dd49-4123-afb1-97704107f8ec tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:15.666931 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2847f277-dd49-4123-afb1-97704107f8ec tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:15.667864 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2847f277-dd49-4123-afb1-97704107f8ec tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:15.668313 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2847f277-dd49-4123-afb1-97704107f8ec tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:15.668946 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2847f277-dd49-4123-afb1-97704107f8ec tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:15.928246 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2847f277-dd49-4123-afb1-97704107f8ec tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:15.938254 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2847f277-dd49-4123-afb1-97704107f8ec tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:15.940173 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2847f277-dd49-4123-afb1-97704107f8ec tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:15.941943 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2847f277-dd49-4123-afb1-97704107f8ec tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1722 microversion: 2.20 time: 0.288219 Aug 26 18:26:15.957325 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 215/437] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:15 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:16.384001 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-43c950e6-88b6-432a-a757-cce5a98e888f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:16.385417 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-43c950e6-88b6-432a-a757-cce5a98e888f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:16.397791 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43c950e6-88b6-432a-a757-cce5a98e888f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:16.398523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43c950e6-88b6-432a-a757-cce5a98e888f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:16.399382 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43c950e6-88b6-432a-a757-cce5a98e888f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:16.401318 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43c950e6-88b6-432a-a757-cce5a98e888f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:16.401970 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43c950e6-88b6-432a-a757-cce5a98e888f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:16.402601 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43c950e6-88b6-432a-a757-cce5a98e888f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:16.578396 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-43c950e6-88b6-432a-a757-cce5a98e888f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:16.591705 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-43c950e6-88b6-432a-a757-cce5a98e888f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1267 microversion: 2.1 time: 0.211974 Aug 26 18:26:16.592328 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 223/438] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:16 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:16.966504 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d5d6d82e-a6a2-4703-aa73-92cf5a7f2060 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:16.967265 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-d5d6d82e-a6a2-4703-aa73-92cf5a7f2060 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:16.973730 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d5d6d82e-a6a2-4703-aa73-92cf5a7f2060 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:16.974405 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d5d6d82e-a6a2-4703-aa73-92cf5a7f2060 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:16.974886 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d5d6d82e-a6a2-4703-aa73-92cf5a7f2060 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:16.975631 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d5d6d82e-a6a2-4703-aa73-92cf5a7f2060 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:16.976234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d5d6d82e-a6a2-4703-aa73-92cf5a7f2060 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:16.976730 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d5d6d82e-a6a2-4703-aa73-92cf5a7f2060 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:17.119244 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d5d6d82e-a6a2-4703-aa73-92cf5a7f2060 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:17.127795 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d5d6d82e-a6a2-4703-aa73-92cf5a7f2060 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:17.129301 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d5d6d82e-a6a2-4703-aa73-92cf5a7f2060 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:17.130452 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-d5d6d82e-a6a2-4703-aa73-92cf5a7f2060 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1722 microversion: 2.20 time: 0.168011 Aug 26 18:26:17.131028 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 216/439] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:16 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:17.611310 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3c6ce69f-ab43-4dd4-87a6-4afb5c2ddf07 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:17.611977 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3c6ce69f-ab43-4dd4-87a6-4afb5c2ddf07 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:17.618787 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c6ce69f-ab43-4dd4-87a6-4afb5c2ddf07 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:17.619320 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c6ce69f-ab43-4dd4-87a6-4afb5c2ddf07 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:17.619745 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c6ce69f-ab43-4dd4-87a6-4afb5c2ddf07 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:17.620525 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c6ce69f-ab43-4dd4-87a6-4afb5c2ddf07 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:17.621006 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c6ce69f-ab43-4dd4-87a6-4afb5c2ddf07 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:17.621428 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c6ce69f-ab43-4dd4-87a6-4afb5c2ddf07 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:17.762298 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3c6ce69f-ab43-4dd4-87a6-4afb5c2ddf07 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:17.771094 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3c6ce69f-ab43-4dd4-87a6-4afb5c2ddf07 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1267 microversion: 2.1 time: 0.163624 Aug 26 18:26:17.771667 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 224/440] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:17 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:18.154804 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-b426078d-b920-43ae-a7fb-3b0ef2813b1c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:18.155538 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-b426078d-b920-43ae-a7fb-3b0ef2813b1c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:18.162462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b426078d-b920-43ae-a7fb-3b0ef2813b1c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:18.162945 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b426078d-b920-43ae-a7fb-3b0ef2813b1c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:18.163379 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b426078d-b920-43ae-a7fb-3b0ef2813b1c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:18.164072 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b426078d-b920-43ae-a7fb-3b0ef2813b1c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:18.164506 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b426078d-b920-43ae-a7fb-3b0ef2813b1c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:18.164988 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b426078d-b920-43ae-a7fb-3b0ef2813b1c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:18.312696 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b426078d-b920-43ae-a7fb-3b0ef2813b1c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:18.321481 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b426078d-b920-43ae-a7fb-3b0ef2813b1c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:18.322920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b426078d-b920-43ae-a7fb-3b0ef2813b1c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:18.324077 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-b426078d-b920-43ae-a7fb-3b0ef2813b1c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1722 microversion: 2.20 time: 0.173944 Aug 26 18:26:18.324668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 217/441] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:18 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:18.791988 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4d9bc42c-ae0d-4fe2-b144-aa609920f8b9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:18.792582 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4d9bc42c-ae0d-4fe2-b144-aa609920f8b9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:18.801622 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d9bc42c-ae0d-4fe2-b144-aa609920f8b9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:18.802111 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d9bc42c-ae0d-4fe2-b144-aa609920f8b9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:18.802542 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d9bc42c-ae0d-4fe2-b144-aa609920f8b9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:18.803306 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d9bc42c-ae0d-4fe2-b144-aa609920f8b9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:18.803757 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d9bc42c-ae0d-4fe2-b144-aa609920f8b9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:18.804183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d9bc42c-ae0d-4fe2-b144-aa609920f8b9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:18.968784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4d9bc42c-ae0d-4fe2-b144-aa609920f8b9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:18.977357 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4d9bc42c-ae0d-4fe2-b144-aa609920f8b9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1267 microversion: 2.1 time: 0.189449 Aug 26 18:26:18.977938 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 225/442] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:18 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:19.346681 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-65050787-89d6-4263-84be-a8e138ebefbd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:19.347356 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-65050787-89d6-4263-84be-a8e138ebefbd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:19.353851 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-65050787-89d6-4263-84be-a8e138ebefbd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:19.354336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-65050787-89d6-4263-84be-a8e138ebefbd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:19.354776 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-65050787-89d6-4263-84be-a8e138ebefbd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:19.355650 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-65050787-89d6-4263-84be-a8e138ebefbd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:19.356118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-65050787-89d6-4263-84be-a8e138ebefbd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:19.356544 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-65050787-89d6-4263-84be-a8e138ebefbd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:19.455937 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-ab9ddc4e-98ad-411f-b232-4f639b74a780 req-f1b52587-f5bc-4fe1-bb59-97846fea1f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed32b7d-a792-49b2-84e7-962f4d537501", "name": "network-vif-unplugged", "status": "completed", "tag": "ae3cb7b6-5071-4281-b758-acbb49eab67f"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:19.471500 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ab9ddc4e-98ad-411f-b232-4f639b74a780 req-f1b52587-f5bc-4fe1-bb59-97846fea1f3c service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:19.472697 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ab9ddc4e-98ad-411f-b232-4f639b74a780 req-f1b52587-f5bc-4fe1-bb59-97846fea1f3c service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:19.472902 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ab9ddc4e-98ad-411f-b232-4f639b74a780 req-f1b52587-f5bc-4fe1-bb59-97846fea1f3c service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:19.494537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-ab9ddc4e-98ad-411f-b232-4f639b74a780 req-f1b52587-f5bc-4fe1-bb59-97846fea1f3c service nova] Creating event network-vif-unplugged:ae3cb7b6-5071-4281-b758-acbb49eab67f for instance 1ed32b7d-a792-49b2-84e7-962f4d537501 on hv-cinder-85199 Aug 26 18:26:19.503346 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-ab9ddc4e-98ad-411f-b232-4f639b74a780 req-f1b52587-f5bc-4fe1-bb59-97846fea1f3c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052159 Aug 26 18:26:19.504039 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 226/443] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:26:19.553959 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-65050787-89d6-4263-84be-a8e138ebefbd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:19.566613 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-65050787-89d6-4263-84be-a8e138ebefbd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:19.576661 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-65050787-89d6-4263-84be-a8e138ebefbd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:19.578927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-65050787-89d6-4263-84be-a8e138ebefbd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1725 microversion: 2.20 time: 0.236412 Aug 26 18:26:19.585854 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 218/444] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:19 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:19.615272 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f65c9fee-7d9d-4257-b95b-50aeed498933 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef166fff-c4e0-448a-ad2e-80f2564678b0"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:19.618374 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f65c9fee-7d9d-4257-b95b-50aeed498933 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:19.625928 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f65c9fee-7d9d-4257-b95b-50aeed498933 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:19.626240 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f65c9fee-7d9d-4257-b95b-50aeed498933 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:19.626671 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f65c9fee-7d9d-4257-b95b-50aeed498933 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:19.627449 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f65c9fee-7d9d-4257-b95b-50aeed498933 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:19.627892 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f65c9fee-7d9d-4257-b95b-50aeed498933 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:19.628632 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f65c9fee-7d9d-4257-b95b-50aeed498933 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:19.934513 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f65c9fee-7d9d-4257-b95b-50aeed498933 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "POST /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324330 Aug 26 18:26:19.936920 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 227/445] 10.222.0.45 () {62 vars in 1364 bytes} [Fri Aug 26 18:26:19 2022] POST /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/os-volume_attachments => generated 188 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:26:19.998396 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-15fb5cf1-ecbc-4ca9-9392-a7b273456dbe tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:19.999334 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-15fb5cf1-ecbc-4ca9-9392-a7b273456dbe tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:20.026477 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-15fb5cf1-ecbc-4ca9-9392-a7b273456dbe tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:20.026969 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-15fb5cf1-ecbc-4ca9-9392-a7b273456dbe tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:20.027395 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-15fb5cf1-ecbc-4ca9-9392-a7b273456dbe tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:20.028096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-15fb5cf1-ecbc-4ca9-9392-a7b273456dbe tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:20.028537 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-15fb5cf1-ecbc-4ca9-9392-a7b273456dbe tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:20.028981 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-15fb5cf1-ecbc-4ca9-9392-a7b273456dbe tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:20.116132 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-169249f0-a457-43ba-ac0d-6227e1dbfadc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:20.116776 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-169249f0-a457-43ba-ac0d-6227e1dbfadc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:20.123675 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169249f0-a457-43ba-ac0d-6227e1dbfadc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:20.124161 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169249f0-a457-43ba-ac0d-6227e1dbfadc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:20.124583 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169249f0-a457-43ba-ac0d-6227e1dbfadc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:20.125287 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169249f0-a457-43ba-ac0d-6227e1dbfadc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:20.125736 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169249f0-a457-43ba-ac0d-6227e1dbfadc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:20.126153 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169249f0-a457-43ba-ac0d-6227e1dbfadc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:20.163810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:20.171629 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-169249f0-a457-43ba-ac0d-6227e1dbfadc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120539) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 18:26:20.243544 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-169249f0-a457-43ba-ac0d-6227e1dbfadc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "POST /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/action" status: 202 len: 0 microversion: 2.20 time: 0.131323 Aug 26 18:26:20.244356 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 228/446] 10.222.0.45 () {62 vars in 1319 bytes} [Fri Aug 26 18:26:20 2022] POST /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 26 18:26:20.253969 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-33acb402-37cf-4b86-8e23-f31f0f1e5038 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:20.255243 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-33acb402-37cf-4b86-8e23-f31f0f1e5038 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:20.262060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33acb402-37cf-4b86-8e23-f31f0f1e5038 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:20.262584 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33acb402-37cf-4b86-8e23-f31f0f1e5038 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:20.263021 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33acb402-37cf-4b86-8e23-f31f0f1e5038 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:20.263736 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33acb402-37cf-4b86-8e23-f31f0f1e5038 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:20.264186 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33acb402-37cf-4b86-8e23-f31f0f1e5038 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:20.264662 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33acb402-37cf-4b86-8e23-f31f0f1e5038 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:20.293827 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-15fb5cf1-ecbc-4ca9-9392-a7b273456dbe tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:20.306668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-15fb5cf1-ecbc-4ca9-9392-a7b273456dbe tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1455 microversion: 2.1 time: 0.312717 Aug 26 18:26:20.321076 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 219/447] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:19 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1455 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:20.331226 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-dc813f55-1c7e-48ef-a5cf-716995c441b4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:20.331867 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-dc813f55-1c7e-48ef-a5cf-716995c441b4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:20.338130 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc813f55-1c7e-48ef-a5cf-716995c441b4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:20.338890 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc813f55-1c7e-48ef-a5cf-716995c441b4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:20.339527 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc813f55-1c7e-48ef-a5cf-716995c441b4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:20.340289 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc813f55-1c7e-48ef-a5cf-716995c441b4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:20.341026 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc813f55-1c7e-48ef-a5cf-716995c441b4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:20.341205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc813f55-1c7e-48ef-a5cf-716995c441b4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:20.442134 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-33acb402-37cf-4b86-8e23-f31f0f1e5038 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:20.454131 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-33acb402-37cf-4b86-8e23-f31f0f1e5038 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:20.455745 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-33acb402-37cf-4b86-8e23-f31f0f1e5038 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:20.456959 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-33acb402-37cf-4b86-8e23-f31f0f1e5038 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1751 microversion: 2.20 time: 0.207858 Aug 26 18:26:20.457678 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 229/448] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:20 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1751 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:20.510867 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-dc813f55-1c7e-48ef-a5cf-716995c441b4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:20.521243 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-dc813f55-1c7e-48ef-a5cf-716995c441b4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1455 microversion: 2.1 time: 0.193824 Aug 26 18:26:20.522215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 220/449] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:20 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1455 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:26:21.479615 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c1e17b5c-5f83-4a6e-92d7-a5b0c7aed17c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:21.480211 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c1e17b5c-5f83-4a6e-92d7-a5b0c7aed17c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:21.487191 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1e17b5c-5f83-4a6e-92d7-a5b0c7aed17c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:21.487778 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1e17b5c-5f83-4a6e-92d7-a5b0c7aed17c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:21.488492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1e17b5c-5f83-4a6e-92d7-a5b0c7aed17c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:21.489286 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1e17b5c-5f83-4a6e-92d7-a5b0c7aed17c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:21.490133 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1e17b5c-5f83-4a6e-92d7-a5b0c7aed17c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:21.490608 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1e17b5c-5f83-4a6e-92d7-a5b0c7aed17c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:21.754963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c1e17b5c-5f83-4a6e-92d7-a5b0c7aed17c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:21.764205 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c1e17b5c-5f83-4a6e-92d7-a5b0c7aed17c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:21.765675 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c1e17b5c-5f83-4a6e-92d7-a5b0c7aed17c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:21.766823 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c1e17b5c-5f83-4a6e-92d7-a5b0c7aed17c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1753 microversion: 2.20 time: 0.291332 Aug 26 18:26:21.767574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 230/450] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:21 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1753 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:22.790421 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-b09f58b7-4221-4c74-ae30-091b9cd0b482 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:22.791137 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-b09f58b7-4221-4c74-ae30-091b9cd0b482 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:22.799481 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b09f58b7-4221-4c74-ae30-091b9cd0b482 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:22.799834 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b09f58b7-4221-4c74-ae30-091b9cd0b482 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:22.800300 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b09f58b7-4221-4c74-ae30-091b9cd0b482 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:22.801495 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b09f58b7-4221-4c74-ae30-091b9cd0b482 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:22.802585 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b09f58b7-4221-4c74-ae30-091b9cd0b482 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:22.802908 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b09f58b7-4221-4c74-ae30-091b9cd0b482 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:22.857305 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-074b3275-a465-4aee-9df2-9801e0698213 req-167c60c8-dd47-406a-845a-d2c8202441cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570e7fd4-4295-4f3c-9d2a-02f704ea6100", "tag": "fa397c67-c193-42fd-b326-362149109be9"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:22.868084 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-074b3275-a465-4aee-9df2-9801e0698213 req-167c60c8-dd47-406a-845a-d2c8202441cd service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:22.868706 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-074b3275-a465-4aee-9df2-9801e0698213 req-167c60c8-dd47-406a-845a-d2c8202441cd service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:22.869373 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-074b3275-a465-4aee-9df2-9801e0698213 req-167c60c8-dd47-406a-845a-d2c8202441cd service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:22.880869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-074b3275-a465-4aee-9df2-9801e0698213 req-167c60c8-dd47-406a-845a-d2c8202441cd service nova] Creating event network-changed:fa397c67-c193-42fd-b326-362149109be9 for instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 on hv-cinder-85199 Aug 26 18:26:22.886203 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-074b3275-a465-4aee-9df2-9801e0698213 req-167c60c8-dd47-406a-845a-d2c8202441cd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032083 Aug 26 18:26:22.888092 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 231/451] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:26:22.939182 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b09f58b7-4221-4c74-ae30-091b9cd0b482 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:22.950829 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b09f58b7-4221-4c74-ae30-091b9cd0b482 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:22.952960 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b09f58b7-4221-4c74-ae30-091b9cd0b482 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:22.954332 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-b09f58b7-4221-4c74-ae30-091b9cd0b482 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.167929 Aug 26 18:26:22.955138 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 221/452] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:22 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:23.982745 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0d809942-5868-4d2c-b86c-28ac0f2938e9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:23.983485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0d809942-5868-4d2c-b86c-28ac0f2938e9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:23.994335 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d809942-5868-4d2c-b86c-28ac0f2938e9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:23.994816 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d809942-5868-4d2c-b86c-28ac0f2938e9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:23.995246 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d809942-5868-4d2c-b86c-28ac0f2938e9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:23.995942 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d809942-5868-4d2c-b86c-28ac0f2938e9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:23.996399 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d809942-5868-4d2c-b86c-28ac0f2938e9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:23.996841 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d809942-5868-4d2c-b86c-28ac0f2938e9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:24.148310 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0d809942-5868-4d2c-b86c-28ac0f2938e9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:24.158229 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0d809942-5868-4d2c-b86c-28ac0f2938e9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:24.160356 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0d809942-5868-4d2c-b86c-28ac0f2938e9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:24.161928 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0d809942-5868-4d2c-b86c-28ac0f2938e9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.184586 Aug 26 18:26:24.162909 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 232/453] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:23 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:26:25.188548 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-23c41f70-b124-46ab-a011-9ec61c6f2a0a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:25.189419 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-23c41f70-b124-46ab-a011-9ec61c6f2a0a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:25.196393 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23c41f70-b124-46ab-a011-9ec61c6f2a0a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:25.196992 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23c41f70-b124-46ab-a011-9ec61c6f2a0a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:25.197637 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23c41f70-b124-46ab-a011-9ec61c6f2a0a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:25.198411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23c41f70-b124-46ab-a011-9ec61c6f2a0a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:25.198934 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23c41f70-b124-46ab-a011-9ec61c6f2a0a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:25.199414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23c41f70-b124-46ab-a011-9ec61c6f2a0a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:25.423719 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-23c41f70-b124-46ab-a011-9ec61c6f2a0a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:25.432469 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-23c41f70-b124-46ab-a011-9ec61c6f2a0a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:25.441262 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-23c41f70-b124-46ab-a011-9ec61c6f2a0a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:25.447482 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-23c41f70-b124-46ab-a011-9ec61c6f2a0a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.263196 Aug 26 18:26:25.448881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 222/454] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:25 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:25.586944 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-513dfb5b-7bee-4653-9381-49c0b6c6edd5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:25.587524 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-513dfb5b-7bee-4653-9381-49c0b6c6edd5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:25.602526 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-513dfb5b-7bee-4653-9381-49c0b6c6edd5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:25.603023 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-513dfb5b-7bee-4653-9381-49c0b6c6edd5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:25.603454 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-513dfb5b-7bee-4653-9381-49c0b6c6edd5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:25.604465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-513dfb5b-7bee-4653-9381-49c0b6c6edd5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:25.604944 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-513dfb5b-7bee-4653-9381-49c0b6c6edd5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:25.605366 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-513dfb5b-7bee-4653-9381-49c0b6c6edd5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:25.630673 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-513dfb5b-7bee-4653-9381-49c0b6c6edd5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b/ips" status: 200 len: 149 microversion: 2.1 time: 0.048458 Aug 26 18:26:25.631882 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 233/455] 10.222.0.45 () {58 vars in 1248 bytes} [Fri Aug 26 18:26:25 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:26:26.473921 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-73da4591-f91e-42f7-9bd5-4efaa8cea792 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:26.474529 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-73da4591-f91e-42f7-9bd5-4efaa8cea792 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:26.482367 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-73da4591-f91e-42f7-9bd5-4efaa8cea792 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:26.483149 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-73da4591-f91e-42f7-9bd5-4efaa8cea792 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:26.483743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-73da4591-f91e-42f7-9bd5-4efaa8cea792 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:26.484698 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-73da4591-f91e-42f7-9bd5-4efaa8cea792 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:26.485443 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-73da4591-f91e-42f7-9bd5-4efaa8cea792 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:26.486178 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-73da4591-f91e-42f7-9bd5-4efaa8cea792 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:26.651839 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-73da4591-f91e-42f7-9bd5-4efaa8cea792 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:26.663533 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-73da4591-f91e-42f7-9bd5-4efaa8cea792 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:26.665895 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-73da4591-f91e-42f7-9bd5-4efaa8cea792 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:26.667830 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-73da4591-f91e-42f7-9bd5-4efaa8cea792 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.198001 Aug 26 18:26:26.668986 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 223/456] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:26 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:27.112485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-657e9ec5-706e-4ab5-a85e-9dd04751030c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3821b2b8-6081-41b9-a7df-6a6eccaeb4a5"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:27.116375 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-657e9ec5-706e-4ab5-a85e-9dd04751030c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:27.133045 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-657e9ec5-706e-4ab5-a85e-9dd04751030c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:27.134133 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-657e9ec5-706e-4ab5-a85e-9dd04751030c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:27.134802 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-657e9ec5-706e-4ab5-a85e-9dd04751030c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:27.135824 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-657e9ec5-706e-4ab5-a85e-9dd04751030c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:27.136322 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-657e9ec5-706e-4ab5-a85e-9dd04751030c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:27.136812 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-657e9ec5-706e-4ab5-a85e-9dd04751030c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:27.693378 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-75889010-1a18-4406-9b68-7a95e1e5bb30 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:27.694069 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-75889010-1a18-4406-9b68-7a95e1e5bb30 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:27.701866 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-75889010-1a18-4406-9b68-7a95e1e5bb30 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:27.704668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-75889010-1a18-4406-9b68-7a95e1e5bb30 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:27.704668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-75889010-1a18-4406-9b68-7a95e1e5bb30 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:27.705150 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-75889010-1a18-4406-9b68-7a95e1e5bb30 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:27.705897 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-75889010-1a18-4406-9b68-7a95e1e5bb30 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:27.706297 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-75889010-1a18-4406-9b68-7a95e1e5bb30 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:28.207101 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-75889010-1a18-4406-9b68-7a95e1e5bb30 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:28.215735 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-75889010-1a18-4406-9b68-7a95e1e5bb30 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:28.217275 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-75889010-1a18-4406-9b68-7a95e1e5bb30 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:28.218470 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-75889010-1a18-4406-9b68-7a95e1e5bb30 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.529651 Aug 26 18:26:28.219024 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 224/457] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:27 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:29.073373 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1036994166", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "networks": [{"uuid": "07b555a3-c19d-4c21-bccd-350015a07615"}]}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:29.128876 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.network.neutron [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] validate_networks() for [('07b555a3-c19d-4c21-bccd-350015a07615', None, None, None, None, None)] {{(pid=120540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:26:29.485920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Flavor limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:26:29.486419 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Image limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:26:29.486961 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Flavor pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:26:29.487432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Image pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:26:29.487928 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:26:29.497289 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:29.497768 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:29.498196 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:29.498983 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:29.499435 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:29.499888 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:29.506780 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=100 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:29.518195 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Getting quotas for project e19db2164fb9439c8b079f2baf661b40. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:26:29.522607 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Getting quotas for user 6a8b301eeb0c4cbda40494e57ba78e52 and project e19db2164fb9439c8b079f2baf661b40. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:26:29.534124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Going to run 1 instances... {{(pid=120540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:26:29.537009 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:26:29.588231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-37859de5-73d3-4409-a64b-3b1a97becf63 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518657 Aug 26 18:26:29.588914 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 225/458] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:26:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 18:26:29.593722 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-783bebcb-5d5d-4f73-92ec-eb3cf8e8be13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:29.594520 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-783bebcb-5d5d-4f73-92ec-eb3cf8e8be13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:29.601073 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-783bebcb-5d5d-4f73-92ec-eb3cf8e8be13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:29.601651 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-783bebcb-5d5d-4f73-92ec-eb3cf8e8be13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:29.602078 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-783bebcb-5d5d-4f73-92ec-eb3cf8e8be13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:29.602758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-783bebcb-5d5d-4f73-92ec-eb3cf8e8be13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:29.603194 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-783bebcb-5d5d-4f73-92ec-eb3cf8e8be13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:29.603605 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-783bebcb-5d5d-4f73-92ec-eb3cf8e8be13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:29.772361 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-783bebcb-5d5d-4f73-92ec-eb3cf8e8be13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:29.781756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-783bebcb-5d5d-4f73-92ec-eb3cf8e8be13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:29.783251 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-783bebcb-5d5d-4f73-92ec-eb3cf8e8be13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:29.784492 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-783bebcb-5d5d-4f73-92ec-eb3cf8e8be13 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.194597 Aug 26 18:26:29.807358 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 226/459] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:29 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:29.812474 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-78966bd7-7fbf-4178-9af7-64138e2b1575 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:29.813104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-78966bd7-7fbf-4178-9af7-64138e2b1575 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:29.882540 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-78966bd7-7fbf-4178-9af7-64138e2b1575 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:29.889889 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-78966bd7-7fbf-4178-9af7-64138e2b1575 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1219 microversion: 2.1 time: 0.081406 Aug 26 18:26:29.890494 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 227/460] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:29 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:30.813671 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9dddf799-7c1e-435f-aca7-37a534926b5c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:30.814472 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9dddf799-7c1e-435f-aca7-37a534926b5c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:30.821226 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9dddf799-7c1e-435f-aca7-37a534926b5c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:30.821706 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9dddf799-7c1e-435f-aca7-37a534926b5c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:30.822130 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9dddf799-7c1e-435f-aca7-37a534926b5c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:30.822824 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9dddf799-7c1e-435f-aca7-37a534926b5c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:30.823267 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9dddf799-7c1e-435f-aca7-37a534926b5c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:30.823684 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9dddf799-7c1e-435f-aca7-37a534926b5c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:30.956415 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9dddf799-7c1e-435f-aca7-37a534926b5c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:30.969004 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9dddf799-7c1e-435f-aca7-37a534926b5c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:30.970435 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9dddf799-7c1e-435f-aca7-37a534926b5c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:30.971604 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9dddf799-7c1e-435f-aca7-37a534926b5c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.162053 Aug 26 18:26:30.972409 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 228/461] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:30 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:30.976661 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4a69fdc3-7c14-4f10-b4d3-4b17a41fd8a2 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:30.977303 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4a69fdc3-7c14-4f10-b4d3-4b17a41fd8a2 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:30.983600 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4a69fdc3-7c14-4f10-b4d3-4b17a41fd8a2 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:30.984278 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4a69fdc3-7c14-4f10-b4d3-4b17a41fd8a2 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:30.984988 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4a69fdc3-7c14-4f10-b4d3-4b17a41fd8a2 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:30.985926 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4a69fdc3-7c14-4f10-b4d3-4b17a41fd8a2 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:30.986371 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4a69fdc3-7c14-4f10-b4d3-4b17a41fd8a2 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:30.986806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4a69fdc3-7c14-4f10-b4d3-4b17a41fd8a2 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:31.049524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-4a69fdc3-7c14-4f10-b4d3-4b17a41fd8a2 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:31.057357 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4a69fdc3-7c14-4f10-b4d3-4b17a41fd8a2 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1223 microversion: 2.1 time: 0.084246 Aug 26 18:26:31.057930 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 229/462] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:30 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:31.996026 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-25b88b62-7525-4297-8ea3-3eff1dfd9288 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:31.996783 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-25b88b62-7525-4297-8ea3-3eff1dfd9288 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:32.003430 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-25b88b62-7525-4297-8ea3-3eff1dfd9288 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:32.003914 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-25b88b62-7525-4297-8ea3-3eff1dfd9288 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:32.004353 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-25b88b62-7525-4297-8ea3-3eff1dfd9288 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:32.005090 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-25b88b62-7525-4297-8ea3-3eff1dfd9288 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:32.005535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-25b88b62-7525-4297-8ea3-3eff1dfd9288 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:32.005956 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-25b88b62-7525-4297-8ea3-3eff1dfd9288 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:32.153708 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-25b88b62-7525-4297-8ea3-3eff1dfd9288 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:32.162731 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-25b88b62-7525-4297-8ea3-3eff1dfd9288 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:32.164135 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-25b88b62-7525-4297-8ea3-3eff1dfd9288 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:32.165347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-25b88b62-7525-4297-8ea3-3eff1dfd9288 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.173572 Aug 26 18:26:32.165885 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 230/463] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:31 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:32.170288 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d664aa7c-2556-4937-8938-7f047703817f tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:32.170970 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-d664aa7c-2556-4937-8938-7f047703817f tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:32.176490 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d664aa7c-2556-4937-8938-7f047703817f tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:32.177011 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d664aa7c-2556-4937-8938-7f047703817f tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:32.177429 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d664aa7c-2556-4937-8938-7f047703817f tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:32.178095 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d664aa7c-2556-4937-8938-7f047703817f tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:32.178533 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d664aa7c-2556-4937-8938-7f047703817f tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:32.178946 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d664aa7c-2556-4937-8938-7f047703817f tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:32.239760 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d664aa7c-2556-4937-8938-7f047703817f tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:32.247835 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-d664aa7c-2556-4937-8938-7f047703817f tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1223 microversion: 2.1 time: 0.080884 Aug 26 18:26:32.248348 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 231/464] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:32 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:33.188404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c443adae-1473-4ed3-b8e5-184c6a6a7364 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:33.189145 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c443adae-1473-4ed3-b8e5-184c6a6a7364 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:33.196183 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c443adae-1473-4ed3-b8e5-184c6a6a7364 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:33.196675 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c443adae-1473-4ed3-b8e5-184c6a6a7364 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:33.197228 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c443adae-1473-4ed3-b8e5-184c6a6a7364 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:33.197931 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c443adae-1473-4ed3-b8e5-184c6a6a7364 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:33.198389 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c443adae-1473-4ed3-b8e5-184c6a6a7364 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:33.198926 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c443adae-1473-4ed3-b8e5-184c6a6a7364 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:33.339484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c443adae-1473-4ed3-b8e5-184c6a6a7364 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:33.350667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c443adae-1473-4ed3-b8e5-184c6a6a7364 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:33.352094 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c443adae-1473-4ed3-b8e5-184c6a6a7364 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:33.353291 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c443adae-1473-4ed3-b8e5-184c6a6a7364 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.168909 Aug 26 18:26:33.354078 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 232/465] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:33 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:33.366602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-5b931d9e-ba3e-4072-a69c-a46f2c0dcaed tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:33.367362 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-5b931d9e-ba3e-4072-a69c-a46f2c0dcaed tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:33.373979 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5b931d9e-ba3e-4072-a69c-a46f2c0dcaed tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:33.374464 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5b931d9e-ba3e-4072-a69c-a46f2c0dcaed tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:33.374893 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5b931d9e-ba3e-4072-a69c-a46f2c0dcaed tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:33.375667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5b931d9e-ba3e-4072-a69c-a46f2c0dcaed tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:33.376165 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5b931d9e-ba3e-4072-a69c-a46f2c0dcaed tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:33.376574 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5b931d9e-ba3e-4072-a69c-a46f2c0dcaed tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:33.442557 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5b931d9e-ba3e-4072-a69c-a46f2c0dcaed tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:33.450677 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-5b931d9e-ba3e-4072-a69c-a46f2c0dcaed tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1223 microversion: 2.1 time: 0.088273 Aug 26 18:26:33.451248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 233/466] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:33 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:34.163833 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:34.288284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-657e9ec5-706e-4ab5-a85e-9dd04751030c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "POST /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.179834 Aug 26 18:26:34.288887 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 234/467] 10.222.0.45 () {60 vars in 1323 bytes} [Fri Aug 26 18:26:27 2022] POST /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b/os-volume_attachments => generated 194 bytes in 7182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:26:34.376561 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-aaeef3f5-6572-42f6-aa89-e6802fb8ba87 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:34.377104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-aaeef3f5-6572-42f6-aa89-e6802fb8ba87 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:34.383668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aaeef3f5-6572-42f6-aa89-e6802fb8ba87 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:34.384155 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aaeef3f5-6572-42f6-aa89-e6802fb8ba87 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:34.384582 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aaeef3f5-6572-42f6-aa89-e6802fb8ba87 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:34.385312 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aaeef3f5-6572-42f6-aa89-e6802fb8ba87 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:34.385757 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aaeef3f5-6572-42f6-aa89-e6802fb8ba87 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:34.386188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aaeef3f5-6572-42f6-aa89-e6802fb8ba87 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:34.473586 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5cb62ee4-6b74-4932-805e-9ce5771f66fa tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:34.474286 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5cb62ee4-6b74-4932-805e-9ce5771f66fa tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:34.481447 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cb62ee4-6b74-4932-805e-9ce5771f66fa tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:34.482022 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cb62ee4-6b74-4932-805e-9ce5771f66fa tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:34.482459 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cb62ee4-6b74-4932-805e-9ce5771f66fa tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:34.483156 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cb62ee4-6b74-4932-805e-9ce5771f66fa tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:34.483628 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cb62ee4-6b74-4932-805e-9ce5771f66fa tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:34.484314 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cb62ee4-6b74-4932-805e-9ce5771f66fa tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:34.542157 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-aaeef3f5-6572-42f6-aa89-e6802fb8ba87 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:34.549115 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5cb62ee4-6b74-4932-805e-9ce5771f66fa tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:34.551044 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-aaeef3f5-6572-42f6-aa89-e6802fb8ba87 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:34.552680 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-aaeef3f5-6572-42f6-aa89-e6802fb8ba87 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:34.553874 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-aaeef3f5-6572-42f6-aa89-e6802fb8ba87 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.181428 Aug 26 18:26:34.554436 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 234/468] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:34 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:34.557107 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5cb62ee4-6b74-4932-805e-9ce5771f66fa tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1215 microversion: 2.1 time: 0.089234 Aug 26 18:26:34.557668 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 235/469] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:34 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:26:35.578663 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-169d73bd-1730-4f0f-ab00-893a1a18c4de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:35.579391 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9138bd18-d6e4-4da4-8b0a-22fd838e0646 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:35.579765 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-169d73bd-1730-4f0f-ab00-893a1a18c4de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:35.579869 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9138bd18-d6e4-4da4-8b0a-22fd838e0646 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:35.586531 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169d73bd-1730-4f0f-ab00-893a1a18c4de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:35.587083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169d73bd-1730-4f0f-ab00-893a1a18c4de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:35.587507 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9138bd18-d6e4-4da4-8b0a-22fd838e0646 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:35.587637 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169d73bd-1730-4f0f-ab00-893a1a18c4de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:35.588027 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9138bd18-d6e4-4da4-8b0a-22fd838e0646 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:35.588206 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169d73bd-1730-4f0f-ab00-893a1a18c4de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:35.588467 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9138bd18-d6e4-4da4-8b0a-22fd838e0646 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:35.588703 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169d73bd-1730-4f0f-ab00-893a1a18c4de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:35.589134 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169d73bd-1730-4f0f-ab00-893a1a18c4de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:35.589284 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9138bd18-d6e4-4da4-8b0a-22fd838e0646 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:35.599767 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9138bd18-d6e4-4da4-8b0a-22fd838e0646 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:35.600223 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9138bd18-d6e4-4da4-8b0a-22fd838e0646 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:35.684771 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9138bd18-d6e4-4da4-8b0a-22fd838e0646 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:35.694740 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9138bd18-d6e4-4da4-8b0a-22fd838e0646 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1279 microversion: 2.1 time: 0.119452 Aug 26 18:26:35.698178 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 235/470] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:35 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1279 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:26:35.760135 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-169d73bd-1730-4f0f-ab00-893a1a18c4de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:35.771890 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-169d73bd-1730-4f0f-ab00-893a1a18c4de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:35.773768 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-169d73bd-1730-4f0f-ab00-893a1a18c4de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:35.775008 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-169d73bd-1730-4f0f-ab00-893a1a18c4de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.200626 Aug 26 18:26:35.775581 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 236/471] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:35 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:36.720025 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-a57fd516-7f48-43fb-882d-13c52dfd4016 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:36.720705 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-a57fd516-7f48-43fb-882d-13c52dfd4016 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:36.728491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a57fd516-7f48-43fb-882d-13c52dfd4016 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:36.729075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a57fd516-7f48-43fb-882d-13c52dfd4016 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:36.729504 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a57fd516-7f48-43fb-882d-13c52dfd4016 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:36.730257 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a57fd516-7f48-43fb-882d-13c52dfd4016 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:36.730669 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a57fd516-7f48-43fb-882d-13c52dfd4016 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:36.731138 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a57fd516-7f48-43fb-882d-13c52dfd4016 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:36.797318 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-04db61d6-65ae-400d-90fd-217e593ea3e3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:36.798254 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-04db61d6-65ae-400d-90fd-217e593ea3e3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:36.805617 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04db61d6-65ae-400d-90fd-217e593ea3e3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:36.806645 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04db61d6-65ae-400d-90fd-217e593ea3e3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:36.807444 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04db61d6-65ae-400d-90fd-217e593ea3e3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:36.808689 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04db61d6-65ae-400d-90fd-217e593ea3e3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:36.809241 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04db61d6-65ae-400d-90fd-217e593ea3e3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:36.809993 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04db61d6-65ae-400d-90fd-217e593ea3e3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:36.920015 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a57fd516-7f48-43fb-882d-13c52dfd4016 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:36.928672 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-a57fd516-7f48-43fb-882d-13c52dfd4016 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1319 microversion: 2.1 time: 0.213693 Aug 26 18:26:36.929571 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 236/472] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:36 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:26:36.944703 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-04db61d6-65ae-400d-90fd-217e593ea3e3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:36.955169 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-04db61d6-65ae-400d-90fd-217e593ea3e3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:36.956612 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-04db61d6-65ae-400d-90fd-217e593ea3e3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:36.957845 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-04db61d6-65ae-400d-90fd-217e593ea3e3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.164567 Aug 26 18:26:36.958412 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 237/473] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:36 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:26:37.165671 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-2569563e-5e01-4282-b1aa-2c0eaf620036 req-9870dfb3-fc7c-4313-b28c-4673ab4bdb12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8e9779b-006a-442f-9366-98ffc1100058", "tag": "f7776dfc-a6d2-423e-adaa-bd983a3e8253"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:37.175137 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2569563e-5e01-4282-b1aa-2c0eaf620036 req-9870dfb3-fc7c-4313-b28c-4673ab4bdb12 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:37.175702 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2569563e-5e01-4282-b1aa-2c0eaf620036 req-9870dfb3-fc7c-4313-b28c-4673ab4bdb12 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:37.176217 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2569563e-5e01-4282-b1aa-2c0eaf620036 req-9870dfb3-fc7c-4313-b28c-4673ab4bdb12 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:37.187519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-2569563e-5e01-4282-b1aa-2c0eaf620036 req-9870dfb3-fc7c-4313-b28c-4673ab4bdb12 service nova] Creating event network-changed:f7776dfc-a6d2-423e-adaa-bd983a3e8253 for instance b8e9779b-006a-442f-9366-98ffc1100058 on hv-cinder-85199 Aug 26 18:26:37.192804 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-2569563e-5e01-4282-b1aa-2c0eaf620036 req-9870dfb3-fc7c-4313-b28c-4673ab4bdb12 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030751 Aug 26 18:26:37.193278 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 237/474] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:26:37.950126 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2b715b4f-7b71-4b51-80fa-12b34d390ad9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:37.950759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2b715b4f-7b71-4b51-80fa-12b34d390ad9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:37.957373 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b715b4f-7b71-4b51-80fa-12b34d390ad9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:37.957850 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b715b4f-7b71-4b51-80fa-12b34d390ad9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:37.958277 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b715b4f-7b71-4b51-80fa-12b34d390ad9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:37.958954 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b715b4f-7b71-4b51-80fa-12b34d390ad9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:37.959395 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b715b4f-7b71-4b51-80fa-12b34d390ad9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:37.959815 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b715b4f-7b71-4b51-80fa-12b34d390ad9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:37.981772 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-84cd7836-0f75-4ba6-ae6f-951ea87adbcb tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:37.982467 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-84cd7836-0f75-4ba6-ae6f-951ea87adbcb tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:37.989012 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-84cd7836-0f75-4ba6-ae6f-951ea87adbcb tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:37.992692 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-84cd7836-0f75-4ba6-ae6f-951ea87adbcb tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:37.993222 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-84cd7836-0f75-4ba6-ae6f-951ea87adbcb tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:37.994010 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-84cd7836-0f75-4ba6-ae6f-951ea87adbcb tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:37.994466 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-84cd7836-0f75-4ba6-ae6f-951ea87adbcb tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:37.994886 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-84cd7836-0f75-4ba6-ae6f-951ea87adbcb tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:38.093776 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2b715b4f-7b71-4b51-80fa-12b34d390ad9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:38.101579 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2b715b4f-7b71-4b51-80fa-12b34d390ad9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1319 microversion: 2.1 time: 0.155754 Aug 26 18:26:38.102143 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 238/475] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:37 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:38.128826 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-84cd7836-0f75-4ba6-ae6f-951ea87adbcb tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:38.137732 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-84cd7836-0f75-4ba6-ae6f-951ea87adbcb tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:38.139190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-84cd7836-0f75-4ba6-ae6f-951ea87adbcb tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:38.140414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-84cd7836-0f75-4ba6-ae6f-951ea87adbcb tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.163465 Aug 26 18:26:38.141001 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 238/476] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:37 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:39.123241 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-31630e13-4145-4a4a-9135-873ed6ab2f12 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:39.123868 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-31630e13-4145-4a4a-9135-873ed6ab2f12 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:39.131016 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31630e13-4145-4a4a-9135-873ed6ab2f12 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:39.131863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31630e13-4145-4a4a-9135-873ed6ab2f12 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:39.132312 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31630e13-4145-4a4a-9135-873ed6ab2f12 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:39.133045 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31630e13-4145-4a4a-9135-873ed6ab2f12 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:39.133497 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31630e13-4145-4a4a-9135-873ed6ab2f12 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:39.133957 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31630e13-4145-4a4a-9135-873ed6ab2f12 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:39.171841 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-800fe1f5-a607-4fdf-a68c-5ebda1393dae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:39.172442 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-800fe1f5-a607-4fdf-a68c-5ebda1393dae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:39.181013 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-800fe1f5-a607-4fdf-a68c-5ebda1393dae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:39.181497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-800fe1f5-a607-4fdf-a68c-5ebda1393dae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:39.182107 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-800fe1f5-a607-4fdf-a68c-5ebda1393dae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:39.183332 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-800fe1f5-a607-4fdf-a68c-5ebda1393dae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:39.183791 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-800fe1f5-a607-4fdf-a68c-5ebda1393dae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:39.184205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-800fe1f5-a607-4fdf-a68c-5ebda1393dae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:39.271308 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-31630e13-4145-4a4a-9135-873ed6ab2f12 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:39.279348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-31630e13-4145-4a4a-9135-873ed6ab2f12 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1319 microversion: 2.1 time: 0.160271 Aug 26 18:26:39.279926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 239/477] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:39 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:39.395079 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-800fe1f5-a607-4fdf-a68c-5ebda1393dae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:39.403940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-800fe1f5-a607-4fdf-a68c-5ebda1393dae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:39.405390 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-800fe1f5-a607-4fdf-a68c-5ebda1393dae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:39.406562 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-800fe1f5-a607-4fdf-a68c-5ebda1393dae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.238873 Aug 26 18:26:39.407113 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 239/478] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:39 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:26:40.303225 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7109e914-2dbf-4ee7-843b-c392a8436307 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:40.303832 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7109e914-2dbf-4ee7-843b-c392a8436307 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:40.310502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7109e914-2dbf-4ee7-843b-c392a8436307 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:40.310993 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7109e914-2dbf-4ee7-843b-c392a8436307 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:40.311426 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7109e914-2dbf-4ee7-843b-c392a8436307 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:40.312118 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7109e914-2dbf-4ee7-843b-c392a8436307 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:40.312561 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7109e914-2dbf-4ee7-843b-c392a8436307 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:40.313084 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7109e914-2dbf-4ee7-843b-c392a8436307 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:40.430234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-6dc1122b-7f92-45f3-85d0-7f1e68b748de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:40.430823 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-6dc1122b-7f92-45f3-85d0-7f1e68b748de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:40.432823 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:40.433856 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=8 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:40.440790 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6dc1122b-7f92-45f3-85d0-7f1e68b748de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:40.441248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6dc1122b-7f92-45f3-85d0-7f1e68b748de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:40.441672 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6dc1122b-7f92-45f3-85d0-7f1e68b748de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:40.442362 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6dc1122b-7f92-45f3-85d0-7f1e68b748de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:40.442814 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6dc1122b-7f92-45f3-85d0-7f1e68b748de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:40.443266 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6dc1122b-7f92-45f3-85d0-7f1e68b748de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:40.446303 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7109e914-2dbf-4ee7-843b-c392a8436307 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:40.454174 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7109e914-2dbf-4ee7-843b-c392a8436307 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1319 microversion: 2.1 time: 0.154909 Aug 26 18:26:40.455197 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 240/479] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:40 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:40.578133 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6dc1122b-7f92-45f3-85d0-7f1e68b748de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:40.587144 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6dc1122b-7f92-45f3-85d0-7f1e68b748de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:40.588581 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6dc1122b-7f92-45f3-85d0-7f1e68b748de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:40.589749 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-6dc1122b-7f92-45f3-85d0-7f1e68b748de tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.163907 Aug 26 18:26:40.590310 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 240/480] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:40 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:41.475702 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6bbb43a5-f5df-4cda-a18d-a3f19584ea94 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:41.476542 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6bbb43a5-f5df-4cda-a18d-a3f19584ea94 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:41.484403 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbb43a5-f5df-4cda-a18d-a3f19584ea94 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:41.484932 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbb43a5-f5df-4cda-a18d-a3f19584ea94 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:41.485370 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbb43a5-f5df-4cda-a18d-a3f19584ea94 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:41.486252 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbb43a5-f5df-4cda-a18d-a3f19584ea94 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:41.486738 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbb43a5-f5df-4cda-a18d-a3f19584ea94 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:41.487162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbb43a5-f5df-4cda-a18d-a3f19584ea94 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:41.611626 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-fe819a42-54f3-4108-bbe1-a172d07fec09 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:41.612216 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-fe819a42-54f3-4108-bbe1-a172d07fec09 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:41.620061 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fe819a42-54f3-4108-bbe1-a172d07fec09 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:41.620963 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fe819a42-54f3-4108-bbe1-a172d07fec09 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:41.621527 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fe819a42-54f3-4108-bbe1-a172d07fec09 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:41.622417 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fe819a42-54f3-4108-bbe1-a172d07fec09 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:41.622867 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fe819a42-54f3-4108-bbe1-a172d07fec09 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:41.623281 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fe819a42-54f3-4108-bbe1-a172d07fec09 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:41.623403 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6bbb43a5-f5df-4cda-a18d-a3f19584ea94 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:41.632868 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6bbb43a5-f5df-4cda-a18d-a3f19584ea94 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1319 microversion: 2.1 time: 0.161132 Aug 26 18:26:41.645818 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 241/481] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:41 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:41.763475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-fe819a42-54f3-4108-bbe1-a172d07fec09 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:41.772896 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-fe819a42-54f3-4108-bbe1-a172d07fec09 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:41.774405 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-fe819a42-54f3-4108-bbe1-a172d07fec09 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:41.775644 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-fe819a42-54f3-4108-bbe1-a172d07fec09 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.168063 Aug 26 18:26:41.776253 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 241/482] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:41 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:26:42.658658 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0cdfdad4-14a4-4dc3-94b8-af2d95c445e9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:42.659668 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0cdfdad4-14a4-4dc3-94b8-af2d95c445e9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:42.670356 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cdfdad4-14a4-4dc3-94b8-af2d95c445e9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:42.671160 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cdfdad4-14a4-4dc3-94b8-af2d95c445e9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:42.671957 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cdfdad4-14a4-4dc3-94b8-af2d95c445e9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:42.673132 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cdfdad4-14a4-4dc3-94b8-af2d95c445e9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:42.673869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cdfdad4-14a4-4dc3-94b8-af2d95c445e9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:42.674476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cdfdad4-14a4-4dc3-94b8-af2d95c445e9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:42.798591 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-400db9bf-3dc9-4714-9c7a-c77b5c644d29 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:42.799183 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-400db9bf-3dc9-4714-9c7a-c77b5c644d29 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:42.806023 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-400db9bf-3dc9-4714-9c7a-c77b5c644d29 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:42.806542 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-400db9bf-3dc9-4714-9c7a-c77b5c644d29 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:42.806981 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-400db9bf-3dc9-4714-9c7a-c77b5c644d29 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:42.807805 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-400db9bf-3dc9-4714-9c7a-c77b5c644d29 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:42.808614 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-400db9bf-3dc9-4714-9c7a-c77b5c644d29 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:42.808614 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-400db9bf-3dc9-4714-9c7a-c77b5c644d29 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:42.818643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0cdfdad4-14a4-4dc3-94b8-af2d95c445e9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:42.826952 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0cdfdad4-14a4-4dc3-94b8-af2d95c445e9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1319 microversion: 2.1 time: 0.174738 Aug 26 18:26:42.827756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 242/483] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:42 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:42.934605 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dc2fe4e1-e791-4fc4-ae86-e400f61c7818 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Action: 'create', calling method: .version_select at 0x7fc74425aa60>, body: {"keypair": {"name": "tempest-keypair-112475887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhQ8y8nZyskC7C+j4wSGr7L5Sb5eSxRnrqssx1QVuCTNcWKkwZSVDMLiHlfiUhwrAsSUEgBumkX3FZC6YQ0A5W42qO3SeKTBqyZtb3rOmtmSQvyk+hDFvE5+2t4yKCsog=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:42.947615 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-400db9bf-3dc9-4714-9c7a-c77b5c644d29 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:42.951232 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-dc2fe4e1-e791-4fc4-ae86-e400f61c7818 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:26:42.955442 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-dc2fe4e1-e791-4fc4-ae86-e400f61c7818 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for user a1be02f9e7fd4bdabc05ec48e2a35f56 and project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:26:42.956510 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-400db9bf-3dc9-4714-9c7a-c77b5c644d29 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:42.957963 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-400db9bf-3dc9-4714-9c7a-c77b5c644d29 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:42.959120 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-400db9bf-3dc9-4714-9c7a-c77b5c644d29 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.164580 Aug 26 18:26:42.959685 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 242/484] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:42 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:42.980652 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dc2fe4e1-e791-4fc4-ae86-e400f61c7818 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049939 Aug 26 18:26:42.981296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 243/485] 10.222.0.45 () {60 vars in 1159 bytes} [Fri Aug 26 18:26:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:26:43.723124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-45310f09-0a32-4619-93e9-2122ca6d4e6e req-614ff454-3552-455c-b3d2-e74ea30a29f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e9779b-006a-442f-9366-98ffc1100058", "name": "network-vif-plugged", "status": "completed", "tag": "f7776dfc-a6d2-423e-adaa-bd983a3e8253"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:43.733533 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-45310f09-0a32-4619-93e9-2122ca6d4e6e req-614ff454-3552-455c-b3d2-e74ea30a29f4 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:43.734088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-45310f09-0a32-4619-93e9-2122ca6d4e6e req-614ff454-3552-455c-b3d2-e74ea30a29f4 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:43.734573 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-45310f09-0a32-4619-93e9-2122ca6d4e6e req-614ff454-3552-455c-b3d2-e74ea30a29f4 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:43.747652 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-45310f09-0a32-4619-93e9-2122ca6d4e6e req-614ff454-3552-455c-b3d2-e74ea30a29f4 service nova] Creating event network-vif-plugged:f7776dfc-a6d2-423e-adaa-bd983a3e8253 for instance b8e9779b-006a-442f-9366-98ffc1100058 on hv-cinder-85199 Aug 26 18:26:43.753550 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-45310f09-0a32-4619-93e9-2122ca6d4e6e req-614ff454-3552-455c-b3d2-e74ea30a29f4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034705 Aug 26 18:26:43.754434 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 243/486] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:26:43.849022 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f2d34937-8ab2-49d7-9c2b-f82ffe9baf01 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:43.850592 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f2d34937-8ab2-49d7-9c2b-f82ffe9baf01 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:43.860173 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2d34937-8ab2-49d7-9c2b-f82ffe9baf01 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:43.861273 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2d34937-8ab2-49d7-9c2b-f82ffe9baf01 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:43.863041 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2d34937-8ab2-49d7-9c2b-f82ffe9baf01 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:43.864472 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2d34937-8ab2-49d7-9c2b-f82ffe9baf01 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:43.865219 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2d34937-8ab2-49d7-9c2b-f82ffe9baf01 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:43.866168 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2d34937-8ab2-49d7-9c2b-f82ffe9baf01 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:43.983160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-3a9bc1e0-2beb-4a31-9feb-dfcd07842aff tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:43.983850 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-3a9bc1e0-2beb-4a31-9feb-dfcd07842aff tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:43.990799 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a9bc1e0-2beb-4a31-9feb-dfcd07842aff tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:43.991243 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a9bc1e0-2beb-4a31-9feb-dfcd07842aff tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:43.991830 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a9bc1e0-2beb-4a31-9feb-dfcd07842aff tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:43.992823 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a9bc1e0-2beb-4a31-9feb-dfcd07842aff tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:43.993411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a9bc1e0-2beb-4a31-9feb-dfcd07842aff tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:43.993973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a9bc1e0-2beb-4a31-9feb-dfcd07842aff tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:44.007304 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f2d34937-8ab2-49d7-9c2b-f82ffe9baf01 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:44.017460 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f2d34937-8ab2-49d7-9c2b-f82ffe9baf01 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1319 microversion: 2.1 time: 0.173754 Aug 26 18:26:44.029041 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 244/487] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:43 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:44.458478 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3a9bc1e0-2beb-4a31-9feb-dfcd07842aff tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:44.462735 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=100 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:44.469752 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3a9bc1e0-2beb-4a31-9feb-dfcd07842aff tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:44.471609 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3a9bc1e0-2beb-4a31-9feb-dfcd07842aff tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:44.472805 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-3a9bc1e0-2beb-4a31-9feb-dfcd07842aff tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.494568 Aug 26 18:26:44.473360 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 244/488] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:43 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:26:44.659092 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-270095339", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d4880b7-d8b8-43ef-a723-cbc27eb026db"}], "security_groups": [{"name": "tempest-securitygroup--234072170"}], "key_name": "tempest-keypair-112475887", "user_data": "}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:44.763611 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] validate_networks() for [('2d4880b7-d8b8-43ef-a723-cbc27eb026db', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:26:45.039144 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-67a8df3b-1c68-4006-96cc-ed5f2b145253 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:45.039724 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-67a8df3b-1c68-4006-96cc-ed5f2b145253 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:45.042077 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:45.047691 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-67a8df3b-1c68-4006-96cc-ed5f2b145253 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:45.048204 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-67a8df3b-1c68-4006-96cc-ed5f2b145253 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:45.048630 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-67a8df3b-1c68-4006-96cc-ed5f2b145253 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:45.049397 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-67a8df3b-1c68-4006-96cc-ed5f2b145253 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:45.049842 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-67a8df3b-1c68-4006-96cc-ed5f2b145253 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:45.050263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-67a8df3b-1c68-4006-96cc-ed5f2b145253 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:45.145779 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:26:45.146281 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:26:45.146639 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:26:45.147036 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:26:45.147440 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:26:45.156812 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:45.157292 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:45.157713 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:45.158458 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:45.158942 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:45.159367 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:45.175728 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:26:45.179673 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for user a1be02f9e7fd4bdabc05ec48e2a35f56 and project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:26:45.182472 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-67a8df3b-1c68-4006-96cc-ed5f2b145253 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:45.190308 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-67a8df3b-1c68-4006-96cc-ed5f2b145253 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1319 microversion: 2.1 time: 0.155122 Aug 26 18:26:45.190545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:26:45.191090 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 245/489] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:45 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:45.193008 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:26:45.241085 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-61add8c7-3ff3-4e47-a73e-9cb0757bfa1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.585487 Aug 26 18:26:45.241775 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 245/490] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:26:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 18:26:45.252738 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ee458e99-249f-4d5b-ad7e-8b0d3e2baaa1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:45.253358 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ee458e99-249f-4d5b-ad7e-8b0d3e2baaa1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:45.306896 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ee458e99-249f-4d5b-ad7e-8b0d3e2baaa1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:45.313880 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ee458e99-249f-4d5b-ad7e-8b0d3e2baaa1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1240 microversion: 2.1 time: 0.065108 Aug 26 18:26:45.314430 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 246/491] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:45 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:45.496026 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-56fd6fe3-588e-4b79-b7f9-0c8792978c3d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:45.496026 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-56fd6fe3-588e-4b79-b7f9-0c8792978c3d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:45.509680 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56fd6fe3-588e-4b79-b7f9-0c8792978c3d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:45.510127 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56fd6fe3-588e-4b79-b7f9-0c8792978c3d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:45.510593 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56fd6fe3-588e-4b79-b7f9-0c8792978c3d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:45.511325 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56fd6fe3-588e-4b79-b7f9-0c8792978c3d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:45.511821 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56fd6fe3-588e-4b79-b7f9-0c8792978c3d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:45.512453 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56fd6fe3-588e-4b79-b7f9-0c8792978c3d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:45.662305 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-56fd6fe3-588e-4b79-b7f9-0c8792978c3d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:45.672549 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-56fd6fe3-588e-4b79-b7f9-0c8792978c3d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:45.674234 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-56fd6fe3-588e-4b79-b7f9-0c8792978c3d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:45.675481 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-56fd6fe3-588e-4b79-b7f9-0c8792978c3d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.184007 Aug 26 18:26:45.676436 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 246/492] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:45 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:45.769307 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-a5f08ada-201c-4113-a3fb-7c7076d3f689 req-d3c6d2d8-3cbd-4fae-96a8-8f629fe490e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed32b7d-a792-49b2-84e7-962f4d537501", "name": "network-vif-plugged", "status": "completed", "tag": "ae3cb7b6-5071-4281-b758-acbb49eab67f"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:45.780027 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-a5f08ada-201c-4113-a3fb-7c7076d3f689 req-d3c6d2d8-3cbd-4fae-96a8-8f629fe490e0 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:45.780497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-a5f08ada-201c-4113-a3fb-7c7076d3f689 req-d3c6d2d8-3cbd-4fae-96a8-8f629fe490e0 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:45.780962 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-a5f08ada-201c-4113-a3fb-7c7076d3f689 req-d3c6d2d8-3cbd-4fae-96a8-8f629fe490e0 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:45.791796 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-a5f08ada-201c-4113-a3fb-7c7076d3f689 req-d3c6d2d8-3cbd-4fae-96a8-8f629fe490e0 service nova] Creating event network-vif-plugged:ae3cb7b6-5071-4281-b758-acbb49eab67f for instance 1ed32b7d-a792-49b2-84e7-962f4d537501 on hv-cinder-85199 Aug 26 18:26:45.796860 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-a5f08ada-201c-4113-a3fb-7c7076d3f689 req-d3c6d2d8-3cbd-4fae-96a8-8f629fe490e0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031310 Aug 26 18:26:45.797456 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 247/493] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:26:46.215221 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f4ffa2a9-4601-4225-a152-b3cb77ba1b69 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:46.216283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f4ffa2a9-4601-4225-a152-b3cb77ba1b69 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:46.227180 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ffa2a9-4601-4225-a152-b3cb77ba1b69 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:46.228794 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ffa2a9-4601-4225-a152-b3cb77ba1b69 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:46.229067 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ffa2a9-4601-4225-a152-b3cb77ba1b69 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:46.230218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ffa2a9-4601-4225-a152-b3cb77ba1b69 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:46.231085 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ffa2a9-4601-4225-a152-b3cb77ba1b69 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:46.231793 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ffa2a9-4601-4225-a152-b3cb77ba1b69 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:46.336308 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-186172ed-3908-419a-882e-dd27cc38b593 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:46.337041 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-186172ed-3908-419a-882e-dd27cc38b593 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:46.343196 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-186172ed-3908-419a-882e-dd27cc38b593 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:46.343880 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-186172ed-3908-419a-882e-dd27cc38b593 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:46.344439 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-186172ed-3908-419a-882e-dd27cc38b593 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:46.345284 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-186172ed-3908-419a-882e-dd27cc38b593 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:46.345724 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-186172ed-3908-419a-882e-dd27cc38b593 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:46.346163 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-186172ed-3908-419a-882e-dd27cc38b593 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:46.376310 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f4ffa2a9-4601-4225-a152-b3cb77ba1b69 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:46.384797 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f4ffa2a9-4601-4225-a152-b3cb77ba1b69 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1508 microversion: 2.1 time: 0.176048 Aug 26 18:26:46.385384 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 247/494] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:46 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:46.410452 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-186172ed-3908-419a-882e-dd27cc38b593 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:46.418267 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-186172ed-3908-419a-882e-dd27cc38b593 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1236 microversion: 2.1 time: 0.087217 Aug 26 18:26:46.420074 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 248/495] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:46 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1236 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:26:46.701723 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-29960571-846d-411a-9be4-295bb7d90fe2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:46.702594 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-29960571-846d-411a-9be4-295bb7d90fe2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:46.710331 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29960571-846d-411a-9be4-295bb7d90fe2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:46.710936 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29960571-846d-411a-9be4-295bb7d90fe2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:46.712057 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29960571-846d-411a-9be4-295bb7d90fe2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:46.712604 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29960571-846d-411a-9be4-295bb7d90fe2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:46.713212 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29960571-846d-411a-9be4-295bb7d90fe2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:46.713633 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29960571-846d-411a-9be4-295bb7d90fe2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:46.894005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-29960571-846d-411a-9be4-295bb7d90fe2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:46.903222 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-29960571-846d-411a-9be4-295bb7d90fe2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:46.904647 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-29960571-846d-411a-9be4-295bb7d90fe2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:46.905986 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-29960571-846d-411a-9be4-295bb7d90fe2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.210490 Aug 26 18:26:46.906545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 248/496] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:46 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:47.439521 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c048b950-2d19-46ff-8078-96b4a4675e35 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:47.440342 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c048b950-2d19-46ff-8078-96b4a4675e35 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:47.452673 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c048b950-2d19-46ff-8078-96b4a4675e35 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:47.453202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c048b950-2d19-46ff-8078-96b4a4675e35 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:47.453635 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c048b950-2d19-46ff-8078-96b4a4675e35 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:47.454338 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c048b950-2d19-46ff-8078-96b4a4675e35 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:47.454842 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c048b950-2d19-46ff-8078-96b4a4675e35 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:47.455274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c048b950-2d19-46ff-8078-96b4a4675e35 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:47.519027 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c048b950-2d19-46ff-8078-96b4a4675e35 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:47.527772 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c048b950-2d19-46ff-8078-96b4a4675e35 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1292 microversion: 2.1 time: 0.092074 Aug 26 18:26:47.528367 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 249/497] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:47 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:47.929429 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7b21ec6f-63d1-47d1-a7cd-a2299a24f8a4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:47.930038 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7b21ec6f-63d1-47d1-a7cd-a2299a24f8a4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:47.936746 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b21ec6f-63d1-47d1-a7cd-a2299a24f8a4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:47.937259 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b21ec6f-63d1-47d1-a7cd-a2299a24f8a4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:47.937711 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b21ec6f-63d1-47d1-a7cd-a2299a24f8a4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:47.938577 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b21ec6f-63d1-47d1-a7cd-a2299a24f8a4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:47.938971 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b21ec6f-63d1-47d1-a7cd-a2299a24f8a4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:47.939371 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b21ec6f-63d1-47d1-a7cd-a2299a24f8a4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:48.071823 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7b21ec6f-63d1-47d1-a7cd-a2299a24f8a4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:48.080676 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7b21ec6f-63d1-47d1-a7cd-a2299a24f8a4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:48.082177 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7b21ec6f-63d1-47d1-a7cd-a2299a24f8a4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:48.083304 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7b21ec6f-63d1-47d1-a7cd-a2299a24f8a4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.157772 Aug 26 18:26:48.083993 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 249/498] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:47 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:48.551084 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-a5767948-70d3-4b9f-96ab-97272faf3073 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:48.551714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-a5767948-70d3-4b9f-96ab-97272faf3073 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:48.558551 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5767948-70d3-4b9f-96ab-97272faf3073 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:48.559040 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5767948-70d3-4b9f-96ab-97272faf3073 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:48.559473 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5767948-70d3-4b9f-96ab-97272faf3073 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:48.560168 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5767948-70d3-4b9f-96ab-97272faf3073 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:48.560614 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5767948-70d3-4b9f-96ab-97272faf3073 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:48.561083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5767948-70d3-4b9f-96ab-97272faf3073 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:48.626594 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a5767948-70d3-4b9f-96ab-97272faf3073 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:48.635485 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-a5767948-70d3-4b9f-96ab-97272faf3073 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1292 microversion: 2.1 time: 0.088528 Aug 26 18:26:48.636124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 250/499] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:48 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:49.107022 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d7db01f4-8986-422e-849c-4dc4029463da tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:49.107636 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d7db01f4-8986-422e-849c-4dc4029463da tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:49.114285 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7db01f4-8986-422e-849c-4dc4029463da tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:49.114843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7db01f4-8986-422e-849c-4dc4029463da tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:49.115322 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7db01f4-8986-422e-849c-4dc4029463da tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:49.116085 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7db01f4-8986-422e-849c-4dc4029463da tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:49.116749 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7db01f4-8986-422e-849c-4dc4029463da tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:49.117186 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7db01f4-8986-422e-849c-4dc4029463da tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:49.258309 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d7db01f4-8986-422e-849c-4dc4029463da tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:49.266987 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d7db01f4-8986-422e-849c-4dc4029463da tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:49.268455 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d7db01f4-8986-422e-849c-4dc4029463da tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:49.269630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d7db01f4-8986-422e-849c-4dc4029463da tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1809 microversion: 2.20 time: 0.166677 Aug 26 18:26:49.270495 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 250/500] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:49 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:49.658928 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-980ccab0-7ee2-488d-9252-9a6ab00efa75 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:49.660418 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-980ccab0-7ee2-488d-9252-9a6ab00efa75 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:49.670624 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-980ccab0-7ee2-488d-9252-9a6ab00efa75 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:49.671237 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-980ccab0-7ee2-488d-9252-9a6ab00efa75 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:49.671933 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-980ccab0-7ee2-488d-9252-9a6ab00efa75 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:49.673132 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-980ccab0-7ee2-488d-9252-9a6ab00efa75 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:49.673780 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-980ccab0-7ee2-488d-9252-9a6ab00efa75 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:49.674734 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-980ccab0-7ee2-488d-9252-9a6ab00efa75 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:49.761046 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-980ccab0-7ee2-488d-9252-9a6ab00efa75 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:49.771415 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-980ccab0-7ee2-488d-9252-9a6ab00efa75 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1298 microversion: 2.1 time: 0.117706 Aug 26 18:26:49.772006 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 251/501] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:49 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1298 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:50.294675 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d481b3ac-cccf-4eb6-ba83-d1e1b8a396cc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:50.295261 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d481b3ac-cccf-4eb6-ba83-d1e1b8a396cc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:50.297811 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:50.303652 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d481b3ac-cccf-4eb6-ba83-d1e1b8a396cc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:50.304142 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d481b3ac-cccf-4eb6-ba83-d1e1b8a396cc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:50.304568 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d481b3ac-cccf-4eb6-ba83-d1e1b8a396cc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:50.305317 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d481b3ac-cccf-4eb6-ba83-d1e1b8a396cc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:50.305765 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d481b3ac-cccf-4eb6-ba83-d1e1b8a396cc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:50.306185 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d481b3ac-cccf-4eb6-ba83-d1e1b8a396cc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:50.452294 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d481b3ac-cccf-4eb6-ba83-d1e1b8a396cc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:50.461964 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d481b3ac-cccf-4eb6-ba83-d1e1b8a396cc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:50.463523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d481b3ac-cccf-4eb6-ba83-d1e1b8a396cc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:50.464810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d481b3ac-cccf-4eb6-ba83-d1e1b8a396cc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1796 microversion: 2.20 time: 0.175185 Aug 26 18:26:50.465452 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 251/502] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:26:50 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1796 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:26:50.794413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-deefb9f1-ed93-42df-8dc6-a739e4a6c210 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:50.794946 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-deefb9f1-ed93-42df-8dc6-a739e4a6c210 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:50.801939 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-deefb9f1-ed93-42df-8dc6-a739e4a6c210 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:50.802501 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-deefb9f1-ed93-42df-8dc6-a739e4a6c210 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:50.802991 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-deefb9f1-ed93-42df-8dc6-a739e4a6c210 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:50.803743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-deefb9f1-ed93-42df-8dc6-a739e4a6c210 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:50.804256 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-deefb9f1-ed93-42df-8dc6-a739e4a6c210 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:50.804758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-deefb9f1-ed93-42df-8dc6-a739e4a6c210 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:51.009880 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-deefb9f1-ed93-42df-8dc6-a739e4a6c210 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:51.018255 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-deefb9f1-ed93-42df-8dc6-a739e4a6c210 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1365 microversion: 2.1 time: 0.229528 Aug 26 18:26:51.031775 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 252/503] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:50 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:51.103016 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-8d8ed4e2-18be-439b-b81a-98654e50da20 req-9f6e81fc-9fab-430f-8d62-3edb7b4c8eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1da52f0-5bd3-4c2e-b4e5-87627616f667", "tag": "e6c0fcc7-e805-4ce2-93c2-b4c7a7fb0f4a"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:51.117047 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-8d8ed4e2-18be-439b-b81a-98654e50da20 req-9f6e81fc-9fab-430f-8d62-3edb7b4c8eeb service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:51.117527 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-8d8ed4e2-18be-439b-b81a-98654e50da20 req-9f6e81fc-9fab-430f-8d62-3edb7b4c8eeb service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:51.117958 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-8d8ed4e2-18be-439b-b81a-98654e50da20 req-9f6e81fc-9fab-430f-8d62-3edb7b4c8eeb service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:51.123054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:51.131796 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-8d8ed4e2-18be-439b-b81a-98654e50da20 req-9f6e81fc-9fab-430f-8d62-3edb7b4c8eeb service nova] Creating event network-changed:e6c0fcc7-e805-4ce2-93c2-b4c7a7fb0f4a for instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 on hv-cinder-85199 Aug 26 18:26:51.137568 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-8d8ed4e2-18be-439b-b81a-98654e50da20 req-9f6e81fc-9fab-430f-8d62-3edb7b4c8eeb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038161 Aug 26 18:26:51.138469 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 252/504] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:26:52.040032 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ece84e9c-208d-47f3-9a83-d27177d7383e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:52.040609 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ece84e9c-208d-47f3-9a83-d27177d7383e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:52.047534 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ece84e9c-208d-47f3-9a83-d27177d7383e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:52.048022 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ece84e9c-208d-47f3-9a83-d27177d7383e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:52.048455 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ece84e9c-208d-47f3-9a83-d27177d7383e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:52.049179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ece84e9c-208d-47f3-9a83-d27177d7383e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:52.049660 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ece84e9c-208d-47f3-9a83-d27177d7383e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:52.050084 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ece84e9c-208d-47f3-9a83-d27177d7383e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:52.184309 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ece84e9c-208d-47f3-9a83-d27177d7383e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:52.195582 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ece84e9c-208d-47f3-9a83-d27177d7383e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1365 microversion: 2.1 time: 0.159212 Aug 26 18:26:52.196366 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 253/505] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:52 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:53.218227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cbc864b9-a787-444e-b859-5a8bc8d53bad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:53.219604 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cbc864b9-a787-444e-b859-5a8bc8d53bad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:53.226233 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbc864b9-a787-444e-b859-5a8bc8d53bad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:53.226721 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbc864b9-a787-444e-b859-5a8bc8d53bad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:53.227176 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbc864b9-a787-444e-b859-5a8bc8d53bad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:53.227877 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbc864b9-a787-444e-b859-5a8bc8d53bad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:53.228327 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbc864b9-a787-444e-b859-5a8bc8d53bad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:53.228766 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbc864b9-a787-444e-b859-5a8bc8d53bad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:53.363719 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cbc864b9-a787-444e-b859-5a8bc8d53bad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:53.372521 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cbc864b9-a787-444e-b859-5a8bc8d53bad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1365 microversion: 2.1 time: 0.159499 Aug 26 18:26:53.373146 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 253/506] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:53 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:54.398842 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f89cf34c-51f3-4284-bb0d-11e573974c56 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:54.400389 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f89cf34c-51f3-4284-bb0d-11e573974c56 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:54.411067 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f89cf34c-51f3-4284-bb0d-11e573974c56 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:54.411571 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f89cf34c-51f3-4284-bb0d-11e573974c56 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:54.411999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f89cf34c-51f3-4284-bb0d-11e573974c56 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:54.412703 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f89cf34c-51f3-4284-bb0d-11e573974c56 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:54.413339 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f89cf34c-51f3-4284-bb0d-11e573974c56 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:54.413783 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f89cf34c-51f3-4284-bb0d-11e573974c56 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:54.552166 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f89cf34c-51f3-4284-bb0d-11e573974c56 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:54.560332 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f89cf34c-51f3-4284-bb0d-11e573974c56 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1365 microversion: 2.1 time: 0.169165 Aug 26 18:26:54.560924 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 254/507] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:54 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:55.581568 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-64462b75-0ae2-40c2-9e62-de70f9c19f9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:55.582160 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-64462b75-0ae2-40c2-9e62-de70f9c19f9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:55.584637 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:55.585412 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=10 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:55.591783 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64462b75-0ae2-40c2-9e62-de70f9c19f9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:55.592271 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64462b75-0ae2-40c2-9e62-de70f9c19f9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:55.592750 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64462b75-0ae2-40c2-9e62-de70f9c19f9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:55.593495 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64462b75-0ae2-40c2-9e62-de70f9c19f9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:55.593943 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64462b75-0ae2-40c2-9e62-de70f9c19f9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:55.594357 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64462b75-0ae2-40c2-9e62-de70f9c19f9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:55.737051 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-64462b75-0ae2-40c2-9e62-de70f9c19f9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:55.744753 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-64462b75-0ae2-40c2-9e62-de70f9c19f9b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1365 microversion: 2.1 time: 0.167046 Aug 26 18:26:55.745342 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 254/508] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:55 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:56.765800 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f0fc9609-c5ac-4032-9c66-31c1481a38d9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:56.766431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f0fc9609-c5ac-4032-9c66-31c1481a38d9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:56.768471 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:26:56.774786 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f0fc9609-c5ac-4032-9c66-31c1481a38d9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:56.775261 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f0fc9609-c5ac-4032-9c66-31c1481a38d9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:56.775684 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f0fc9609-c5ac-4032-9c66-31c1481a38d9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:56.776362 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f0fc9609-c5ac-4032-9c66-31c1481a38d9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:56.776847 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f0fc9609-c5ac-4032-9c66-31c1481a38d9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:56.777373 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f0fc9609-c5ac-4032-9c66-31c1481a38d9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:56.908477 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f0fc9609-c5ac-4032-9c66-31c1481a38d9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:56.917993 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f0fc9609-c5ac-4032-9c66-31c1481a38d9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1365 microversion: 2.1 time: 0.156182 Aug 26 18:26:56.918559 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 255/509] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:56 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:57.659606 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-2eef4083-2ba3-424d-8905-c71d965e439b req-dd0a1c5d-d895-4207-a08f-d391b3e1a441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1da52f0-5bd3-4c2e-b4e5-87627616f667", "name": "network-vif-plugged", "status": "completed", "tag": "e6c0fcc7-e805-4ce2-93c2-b4c7a7fb0f4a"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:26:57.671714 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-2eef4083-2ba3-424d-8905-c71d965e439b req-dd0a1c5d-d895-4207-a08f-d391b3e1a441 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:57.672198 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-2eef4083-2ba3-424d-8905-c71d965e439b req-dd0a1c5d-d895-4207-a08f-d391b3e1a441 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:57.672745 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-2eef4083-2ba3-424d-8905-c71d965e439b req-dd0a1c5d-d895-4207-a08f-d391b3e1a441 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:57.686268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-2eef4083-2ba3-424d-8905-c71d965e439b req-dd0a1c5d-d895-4207-a08f-d391b3e1a441 service nova] Creating event network-vif-plugged:e6c0fcc7-e805-4ce2-93c2-b4c7a7fb0f4a for instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 on hv-cinder-85199 Aug 26 18:26:57.691217 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-2eef4083-2ba3-424d-8905-c71d965e439b req-dd0a1c5d-d895-4207-a08f-d391b3e1a441 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035743 Aug 26 18:26:57.691822 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 255/510] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:26:57.939318 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c4164dd1-2069-44bb-b191-44dba392e1e3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:57.939908 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c4164dd1-2069-44bb-b191-44dba392e1e3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:57.947067 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c4164dd1-2069-44bb-b191-44dba392e1e3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:57.947548 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c4164dd1-2069-44bb-b191-44dba392e1e3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:57.947967 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c4164dd1-2069-44bb-b191-44dba392e1e3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:57.948789 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c4164dd1-2069-44bb-b191-44dba392e1e3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:57.949138 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c4164dd1-2069-44bb-b191-44dba392e1e3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:57.949536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c4164dd1-2069-44bb-b191-44dba392e1e3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:58.084603 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c4164dd1-2069-44bb-b191-44dba392e1e3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:58.092379 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c4164dd1-2069-44bb-b191-44dba392e1e3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1365 microversion: 2.1 time: 0.157128 Aug 26 18:26:58.092983 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 256/511] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:57 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:26:59.116578 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ebcb7dfb-5706-4e66-a2fa-ae41c945529f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:26:59.117237 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ebcb7dfb-5706-4e66-a2fa-ae41c945529f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:26:59.123993 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebcb7dfb-5706-4e66-a2fa-ae41c945529f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:59.124473 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebcb7dfb-5706-4e66-a2fa-ae41c945529f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:59.124944 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebcb7dfb-5706-4e66-a2fa-ae41c945529f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:59.125618 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebcb7dfb-5706-4e66-a2fa-ae41c945529f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:26:59.126063 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebcb7dfb-5706-4e66-a2fa-ae41c945529f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:26:59.126488 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebcb7dfb-5706-4e66-a2fa-ae41c945529f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:26:59.262887 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ebcb7dfb-5706-4e66-a2fa-ae41c945529f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:26:59.271541 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ebcb7dfb-5706-4e66-a2fa-ae41c945529f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1365 microversion: 2.1 time: 0.160511 Aug 26 18:26:59.272787 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 256/512] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:26:59 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:00.297461 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-22b711c0-4351-4ec0-9904-6e2d6bc1b02d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:00.298643 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-22b711c0-4351-4ec0-9904-6e2d6bc1b02d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:00.309532 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-22b711c0-4351-4ec0-9904-6e2d6bc1b02d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:00.310333 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-22b711c0-4351-4ec0-9904-6e2d6bc1b02d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:00.311082 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-22b711c0-4351-4ec0-9904-6e2d6bc1b02d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:00.312243 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-22b711c0-4351-4ec0-9904-6e2d6bc1b02d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:00.313049 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-22b711c0-4351-4ec0-9904-6e2d6bc1b02d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:00.313773 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-22b711c0-4351-4ec0-9904-6e2d6bc1b02d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:00.452485 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-22b711c0-4351-4ec0-9904-6e2d6bc1b02d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:00.463275 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-22b711c0-4351-4ec0-9904-6e2d6bc1b02d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1556 microversion: 2.1 time: 0.172310 Aug 26 18:27:00.464026 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 257/513] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:00 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:00.490683 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5fd7859a-f6a8-44c0-ab1a-c6b9478a2103 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:00.491231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5fd7859a-f6a8-44c0-ab1a-c6b9478a2103 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:00.498061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd7859a-f6a8-44c0-ab1a-c6b9478a2103 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:00.498544 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd7859a-f6a8-44c0-ab1a-c6b9478a2103 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:00.498984 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd7859a-f6a8-44c0-ab1a-c6b9478a2103 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:00.499676 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd7859a-f6a8-44c0-ab1a-c6b9478a2103 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:00.500127 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd7859a-f6a8-44c0-ab1a-c6b9478a2103 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:00.500557 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd7859a-f6a8-44c0-ab1a-c6b9478a2103 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:00.578873 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5fd7859a-f6a8-44c0-ab1a-c6b9478a2103 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092252 Aug 26 18:27:00.579511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 257/514] 10.222.0.45 () {58 vars in 1275 bytes} [Fri Aug 26 18:27:00 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:27:01.733521 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-7c536059-275b-4740-888e-b45143dcea2e req-a378f353-9e0f-440f-9504-d22ba5a71462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1da52f0-5bd3-4c2e-b4e5-87627616f667", "tag": "e6c0fcc7-e805-4ce2-93c2-b4c7a7fb0f4a"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:27:01.743787 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-7c536059-275b-4740-888e-b45143dcea2e req-a378f353-9e0f-440f-9504-d22ba5a71462 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:01.744272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-7c536059-275b-4740-888e-b45143dcea2e req-a378f353-9e0f-440f-9504-d22ba5a71462 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:01.744697 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-7c536059-275b-4740-888e-b45143dcea2e req-a378f353-9e0f-440f-9504-d22ba5a71462 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:01.756451 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-7c536059-275b-4740-888e-b45143dcea2e req-a378f353-9e0f-440f-9504-d22ba5a71462 service nova] Creating event network-changed:e6c0fcc7-e805-4ce2-93c2-b4c7a7fb0f4a for instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 on hv-cinder-85199 Aug 26 18:27:01.761931 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-7c536059-275b-4740-888e-b45143dcea2e req-a378f353-9e0f-440f-9504-d22ba5a71462 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032238 Aug 26 18:27:01.762566 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 258/515] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:27:02.165470 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-98980435-bcc3-4d46-9203-e556fc8999a9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fee8972f-344e-4b3f-a6b0-6312a3cc2ffb"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:27:02.167893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-98980435-bcc3-4d46-9203-e556fc8999a9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:02.174270 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98980435-bcc3-4d46-9203-e556fc8999a9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:02.174853 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98980435-bcc3-4d46-9203-e556fc8999a9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:02.175284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98980435-bcc3-4d46-9203-e556fc8999a9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:02.175984 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98980435-bcc3-4d46-9203-e556fc8999a9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:02.176487 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98980435-bcc3-4d46-9203-e556fc8999a9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:02.176925 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98980435-bcc3-4d46-9203-e556fc8999a9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:02.466624 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-98980435-bcc3-4d46-9203-e556fc8999a9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "POST /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305588 Aug 26 18:27:02.467297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 258/516] 10.222.0.45 () {60 vars in 1323 bytes} [Fri Aug 26 18:27:02 2022] POST /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:27:05.338245 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f75db80f-f459-4399-8dd1-b043fa8eba16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:05.339071 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f75db80f-f459-4399-8dd1-b043fa8eba16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:05.347691 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f75db80f-f459-4399-8dd1-b043fa8eba16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:05.348155 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f75db80f-f459-4399-8dd1-b043fa8eba16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:05.348585 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f75db80f-f459-4399-8dd1-b043fa8eba16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:05.349310 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f75db80f-f459-4399-8dd1-b043fa8eba16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:05.349761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f75db80f-f459-4399-8dd1-b043fa8eba16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:05.350187 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f75db80f-f459-4399-8dd1-b043fa8eba16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:05.471639 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-f75db80f-f459-4399-8dd1-b043fa8eba16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lazy-loading 'services' on Instance uuid 024e8a0f-0670-4aec-8ec6-e8afbc67d464 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:27:05.591152 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f75db80f-f459-4399-8dd1-b043fa8eba16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "DELETE /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/os-volume_attachments/0b124389-17a0-4320-bbb5-58f127bc7a70" status: 202 len: 0 microversion: 2.1 time: 0.259579 Aug 26 18:27:05.592006 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 259/517] 10.222.0.45 () {58 vars in 1416 bytes} [Fri Aug 26 18:27:05 2022] DELETE /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/os-volume_attachments/0b124389-17a0-4320-bbb5-58f127bc7a70 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:27:05.870512 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-07ee526c-b488-44b5-9726-e6ff969848d9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11db7da3-b1a3-4e57-a628-621bba591f08", "device": "/dev/sdb"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:27:05.874916 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-07ee526c-b488-44b5-9726-e6ff969848d9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:05.883488 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07ee526c-b488-44b5-9726-e6ff969848d9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:05.884125 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07ee526c-b488-44b5-9726-e6ff969848d9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:05.884802 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07ee526c-b488-44b5-9726-e6ff969848d9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:05.885856 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07ee526c-b488-44b5-9726-e6ff969848d9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:05.886455 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07ee526c-b488-44b5-9726-e6ff969848d9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:05.887068 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07ee526c-b488-44b5-9726-e6ff969848d9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:06.156012 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-07ee526c-b488-44b5-9726-e6ff969848d9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "POST /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291535 Aug 26 18:27:06.156634 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 259/518] 10.222.0.45 () {60 vars in 1323 bytes} [Fri Aug 26 18:27:05 2022] POST /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:27:10.029972 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-b7c16abf-c940-4c5e-8740-a00b37c496d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:27:10.032326 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-b7c16abf-c940-4c5e-8740-a00b37c496d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:10.039442 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b7c16abf-c940-4c5e-8740-a00b37c496d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:10.039923 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b7c16abf-c940-4c5e-8740-a00b37c496d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:10.040353 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b7c16abf-c940-4c5e-8740-a00b37c496d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:10.041050 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b7c16abf-c940-4c5e-8740-a00b37c496d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:10.041498 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b7c16abf-c940-4c5e-8740-a00b37c496d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:10.041915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b7c16abf-c940-4c5e-8740-a00b37c496d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:10.066553 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-b7c16abf-c940-4c5e-8740-a00b37c496d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lazy-loading 'flavor' on Instance uuid 64b399c3-d3a3-4193-9826-e509b3b9b529 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:27:10.199492 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-b7c16abf-c940-4c5e-8740-a00b37c496d8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "POST /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/action" status: 200 len: 32 microversion: 2.1 time: 0.174517 Aug 26 18:27:10.200063 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 260/519] 10.222.0.45 () {60 vars in 1278 bytes} [Fri Aug 26 18:27:10 2022] POST /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 18:27:10.210729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c1bdb361-2007-4c6d-8fd8-69cfe32766a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:10.211560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c1bdb361-2007-4c6d-8fd8-69cfe32766a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:10.218813 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1bdb361-2007-4c6d-8fd8-69cfe32766a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:10.219312 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1bdb361-2007-4c6d-8fd8-69cfe32766a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:10.219776 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1bdb361-2007-4c6d-8fd8-69cfe32766a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:10.220455 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1bdb361-2007-4c6d-8fd8-69cfe32766a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:10.220950 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1bdb361-2007-4c6d-8fd8-69cfe32766a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:10.221378 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1bdb361-2007-4c6d-8fd8-69cfe32766a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:10.366246 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c1bdb361-2007-4c6d-8fd8-69cfe32766a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:10.378198 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c1bdb361-2007-4c6d-8fd8-69cfe32766a8 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.171715 Aug 26 18:27:10.378788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 260/520] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:10 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:27:10.988299 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4888139b-7bb0-4661-8e79-aa68fbac6afc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:27:10.995023 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4888139b-7bb0-4661-8e79-aa68fbac6afc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:10.995499 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4888139b-7bb0-4661-8e79-aa68fbac6afc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:10.995921 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4888139b-7bb0-4661-8e79-aa68fbac6afc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:11.000633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:27:11.023537 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4888139b-7bb0-4661-8e79-aa68fbac6afc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Going to try to stop instance {{(pid=120540) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 18:27:11.071786 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4888139b-7bb0-4661-8e79-aa68fbac6afc tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "POST /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/action" status: 202 len: 0 microversion: 2.1 time: 0.087883 Aug 26 18:27:11.072573 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 261/521] 10.222.0.45 () {60 vars in 1278 bytes} [Fri Aug 26 18:27:10 2022] POST /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:27:11.081158 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9526ef78-a553-415e-8e41-4de61f1f9fe8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:11.082064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9526ef78-a553-415e-8e41-4de61f1f9fe8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:11.089447 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9526ef78-a553-415e-8e41-4de61f1f9fe8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:11.089920 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9526ef78-a553-415e-8e41-4de61f1f9fe8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:11.090359 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9526ef78-a553-415e-8e41-4de61f1f9fe8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:11.091054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9526ef78-a553-415e-8e41-4de61f1f9fe8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:11.091501 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9526ef78-a553-415e-8e41-4de61f1f9fe8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:11.091915 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9526ef78-a553-415e-8e41-4de61f1f9fe8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:11.223648 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9526ef78-a553-415e-8e41-4de61f1f9fe8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:11.232201 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9526ef78-a553-415e-8e41-4de61f1f9fe8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1679 microversion: 2.1 time: 0.154836 Aug 26 18:27:11.232768 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 261/522] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:11 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:11.406978 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f159d01c-5455-427c-88c4-6848e8b6a152 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:11.408863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f159d01c-5455-427c-88c4-6848e8b6a152 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:11.419807 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f159d01c-5455-427c-88c4-6848e8b6a152 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:11.420937 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f159d01c-5455-427c-88c4-6848e8b6a152 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:11.421667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f159d01c-5455-427c-88c4-6848e8b6a152 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:11.422826 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f159d01c-5455-427c-88c4-6848e8b6a152 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:11.423582 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f159d01c-5455-427c-88c4-6848e8b6a152 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:11.424282 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f159d01c-5455-427c-88c4-6848e8b6a152 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:11.561203 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f159d01c-5455-427c-88c4-6848e8b6a152 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:11.569649 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f159d01c-5455-427c-88c4-6848e8b6a152 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.169959 Aug 26 18:27:11.570255 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 262/523] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:11 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:12.254575 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-731b4085-aab4-461e-9d92-16209faafcd3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:12.255238 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-731b4085-aab4-461e-9d92-16209faafcd3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:12.262607 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-731b4085-aab4-461e-9d92-16209faafcd3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:12.263099 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-731b4085-aab4-461e-9d92-16209faafcd3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:12.263520 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-731b4085-aab4-461e-9d92-16209faafcd3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:12.264207 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-731b4085-aab4-461e-9d92-16209faafcd3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:12.264653 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-731b4085-aab4-461e-9d92-16209faafcd3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:12.265109 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-731b4085-aab4-461e-9d92-16209faafcd3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:12.403213 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-731b4085-aab4-461e-9d92-16209faafcd3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:12.411216 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-731b4085-aab4-461e-9d92-16209faafcd3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1679 microversion: 2.1 time: 0.161422 Aug 26 18:27:12.411793 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 262/524] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:12 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:12.591204 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-b164e967-1d42-4f36-9189-f7d5be5ccc0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:12.591876 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-b164e967-1d42-4f36-9189-f7d5be5ccc0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:12.599286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b164e967-1d42-4f36-9189-f7d5be5ccc0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:12.600196 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b164e967-1d42-4f36-9189-f7d5be5ccc0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:12.600832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b164e967-1d42-4f36-9189-f7d5be5ccc0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:12.601854 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b164e967-1d42-4f36-9189-f7d5be5ccc0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:12.602417 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b164e967-1d42-4f36-9189-f7d5be5ccc0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:12.602866 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b164e967-1d42-4f36-9189-f7d5be5ccc0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:12.745199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b164e967-1d42-4f36-9189-f7d5be5ccc0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:12.753825 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-b164e967-1d42-4f36-9189-f7d5be5ccc0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.166646 Aug 26 18:27:12.754394 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 263/525] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:12 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:13.435513 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-36e014d7-aba8-4f28-b6ca-73db966ccd08 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:13.436207 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-36e014d7-aba8-4f28-b6ca-73db966ccd08 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:13.444266 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36e014d7-aba8-4f28-b6ca-73db966ccd08 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:13.444874 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36e014d7-aba8-4f28-b6ca-73db966ccd08 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:13.445387 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36e014d7-aba8-4f28-b6ca-73db966ccd08 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:13.446199 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36e014d7-aba8-4f28-b6ca-73db966ccd08 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:13.446728 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36e014d7-aba8-4f28-b6ca-73db966ccd08 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:13.447228 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36e014d7-aba8-4f28-b6ca-73db966ccd08 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:13.587102 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-36e014d7-aba8-4f28-b6ca-73db966ccd08 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:13.595334 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-36e014d7-aba8-4f28-b6ca-73db966ccd08 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1679 microversion: 2.1 time: 0.164471 Aug 26 18:27:13.595880 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 263/526] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:13 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:27:13.775914 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-3d8fcf94-261a-4153-a7dc-143efdf4a8d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:13.776449 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-3d8fcf94-261a-4153-a7dc-143efdf4a8d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:13.783515 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d8fcf94-261a-4153-a7dc-143efdf4a8d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:13.784000 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d8fcf94-261a-4153-a7dc-143efdf4a8d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:13.784434 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d8fcf94-261a-4153-a7dc-143efdf4a8d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:13.785179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d8fcf94-261a-4153-a7dc-143efdf4a8d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:13.785628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d8fcf94-261a-4153-a7dc-143efdf4a8d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:13.786051 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d8fcf94-261a-4153-a7dc-143efdf4a8d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:13.916675 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3d8fcf94-261a-4153-a7dc-143efdf4a8d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:13.925370 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-3d8fcf94-261a-4153-a7dc-143efdf4a8d9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.153484 Aug 26 18:27:13.925946 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 264/527] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:13 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:14.619759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-30c9cf18-1e1e-46b8-8264-ca1c5bd2e24d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:14.620287 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-30c9cf18-1e1e-46b8-8264-ca1c5bd2e24d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:14.627232 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30c9cf18-1e1e-46b8-8264-ca1c5bd2e24d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:14.627712 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30c9cf18-1e1e-46b8-8264-ca1c5bd2e24d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:14.628140 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30c9cf18-1e1e-46b8-8264-ca1c5bd2e24d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:14.628854 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30c9cf18-1e1e-46b8-8264-ca1c5bd2e24d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:14.629300 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30c9cf18-1e1e-46b8-8264-ca1c5bd2e24d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:14.629716 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30c9cf18-1e1e-46b8-8264-ca1c5bd2e24d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:14.763522 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-30c9cf18-1e1e-46b8-8264-ca1c5bd2e24d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:14.771849 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-30c9cf18-1e1e-46b8-8264-ca1c5bd2e24d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1679 microversion: 2.1 time: 0.158356 Aug 26 18:27:14.772463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 264/528] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:14 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:14.950524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-022c4afc-acb9-46e0-821c-82455bb17bfe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:14.951483 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-022c4afc-acb9-46e0-821c-82455bb17bfe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:14.962014 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-022c4afc-acb9-46e0-821c-82455bb17bfe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:14.962495 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-022c4afc-acb9-46e0-821c-82455bb17bfe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:14.962920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-022c4afc-acb9-46e0-821c-82455bb17bfe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:14.963606 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-022c4afc-acb9-46e0-821c-82455bb17bfe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:14.964055 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-022c4afc-acb9-46e0-821c-82455bb17bfe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:14.964469 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-022c4afc-acb9-46e0-821c-82455bb17bfe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:15.099041 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-022c4afc-acb9-46e0-821c-82455bb17bfe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:15.107515 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-022c4afc-acb9-46e0-821c-82455bb17bfe tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.163372 Aug 26 18:27:15.108081 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 265/529] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:14 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:15.792959 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-edc2e0d5-aa00-4589-ad31-7fbcff35ba01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:15.793561 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-edc2e0d5-aa00-4589-ad31-7fbcff35ba01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:15.800241 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc2e0d5-aa00-4589-ad31-7fbcff35ba01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:15.800768 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc2e0d5-aa00-4589-ad31-7fbcff35ba01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:15.801186 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc2e0d5-aa00-4589-ad31-7fbcff35ba01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:15.801875 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc2e0d5-aa00-4589-ad31-7fbcff35ba01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:15.802324 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc2e0d5-aa00-4589-ad31-7fbcff35ba01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:15.802750 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc2e0d5-aa00-4589-ad31-7fbcff35ba01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:15.934080 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-edc2e0d5-aa00-4589-ad31-7fbcff35ba01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:15.941846 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-edc2e0d5-aa00-4589-ad31-7fbcff35ba01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1679 microversion: 2.1 time: 0.152781 Aug 26 18:27:15.942420 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 265/530] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:15 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:16.133359 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e7fbe5b3-2e6c-467e-a535-d8f02a719a0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:16.134211 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e7fbe5b3-2e6c-467e-a535-d8f02a719a0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:16.138237 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=44 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:27:16.147432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e7fbe5b3-2e6c-467e-a535-d8f02a719a0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:16.148231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e7fbe5b3-2e6c-467e-a535-d8f02a719a0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:16.149013 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e7fbe5b3-2e6c-467e-a535-d8f02a719a0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:16.149730 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e7fbe5b3-2e6c-467e-a535-d8f02a719a0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:16.150175 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e7fbe5b3-2e6c-467e-a535-d8f02a719a0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:16.150592 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e7fbe5b3-2e6c-467e-a535-d8f02a719a0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:16.279706 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e7fbe5b3-2e6c-467e-a535-d8f02a719a0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:16.288133 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e7fbe5b3-2e6c-467e-a535-d8f02a719a0d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.161788 Aug 26 18:27:16.288693 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 266/531] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:16 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:16.965883 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9e98d1c1-10f4-43af-813e-bc6dbead6c6d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:16.966713 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9e98d1c1-10f4-43af-813e-bc6dbead6c6d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:16.975738 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e98d1c1-10f4-43af-813e-bc6dbead6c6d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:16.976375 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e98d1c1-10f4-43af-813e-bc6dbead6c6d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:16.977267 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e98d1c1-10f4-43af-813e-bc6dbead6c6d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:16.978168 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e98d1c1-10f4-43af-813e-bc6dbead6c6d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:16.978758 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e98d1c1-10f4-43af-813e-bc6dbead6c6d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:16.979321 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e98d1c1-10f4-43af-813e-bc6dbead6c6d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:17.113712 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9e98d1c1-10f4-43af-813e-bc6dbead6c6d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:17.121952 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9e98d1c1-10f4-43af-813e-bc6dbead6c6d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1679 microversion: 2.1 time: 0.161662 Aug 26 18:27:17.122517 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 266/532] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:16 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:17.309846 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-38d8eb97-0604-4ecc-b257-8501a83f262f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:17.310599 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-38d8eb97-0604-4ecc-b257-8501a83f262f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:17.317312 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-38d8eb97-0604-4ecc-b257-8501a83f262f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:17.317800 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-38d8eb97-0604-4ecc-b257-8501a83f262f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:17.318209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-38d8eb97-0604-4ecc-b257-8501a83f262f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:17.318930 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-38d8eb97-0604-4ecc-b257-8501a83f262f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:17.319353 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-38d8eb97-0604-4ecc-b257-8501a83f262f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:17.319781 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-38d8eb97-0604-4ecc-b257-8501a83f262f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:17.458223 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-38d8eb97-0604-4ecc-b257-8501a83f262f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:17.468683 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-38d8eb97-0604-4ecc-b257-8501a83f262f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.162382 Aug 26 18:27:17.469583 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 267/533] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:17 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:18.143027 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-14532b2a-467a-4121-a2ef-76fc5471d3ad tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:18.143773 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-14532b2a-467a-4121-a2ef-76fc5471d3ad tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:18.150757 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14532b2a-467a-4121-a2ef-76fc5471d3ad tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:18.151231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14532b2a-467a-4121-a2ef-76fc5471d3ad tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:18.151689 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14532b2a-467a-4121-a2ef-76fc5471d3ad tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:18.152388 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14532b2a-467a-4121-a2ef-76fc5471d3ad tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:18.152897 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14532b2a-467a-4121-a2ef-76fc5471d3ad tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:18.153321 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14532b2a-467a-4121-a2ef-76fc5471d3ad tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:18.288049 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-14532b2a-467a-4121-a2ef-76fc5471d3ad tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:18.290504 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:27:18.297405 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-14532b2a-467a-4121-a2ef-76fc5471d3ad tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1679 microversion: 2.1 time: 0.158326 Aug 26 18:27:18.297952 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 267/534] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:18 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:18.496132 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8260c428-0b9b-4e52-a463-1b7aa47b9ac2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:18.497017 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8260c428-0b9b-4e52-a463-1b7aa47b9ac2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:18.506270 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8260c428-0b9b-4e52-a463-1b7aa47b9ac2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:18.506942 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8260c428-0b9b-4e52-a463-1b7aa47b9ac2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:18.507549 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8260c428-0b9b-4e52-a463-1b7aa47b9ac2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:18.508510 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8260c428-0b9b-4e52-a463-1b7aa47b9ac2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:18.509168 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8260c428-0b9b-4e52-a463-1b7aa47b9ac2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:18.509747 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8260c428-0b9b-4e52-a463-1b7aa47b9ac2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:18.661498 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8260c428-0b9b-4e52-a463-1b7aa47b9ac2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:18.674541 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8260c428-0b9b-4e52-a463-1b7aa47b9ac2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.184108 Aug 26 18:27:18.675335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 268/535] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:18 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:19.322424 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-58a1c4e8-f240-49c8-abb2-43883ad73167 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:19.323656 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-58a1c4e8-f240-49c8-abb2-43883ad73167 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:19.336127 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58a1c4e8-f240-49c8-abb2-43883ad73167 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:19.336830 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58a1c4e8-f240-49c8-abb2-43883ad73167 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:19.337297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58a1c4e8-f240-49c8-abb2-43883ad73167 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:19.338009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58a1c4e8-f240-49c8-abb2-43883ad73167 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:19.338458 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58a1c4e8-f240-49c8-abb2-43883ad73167 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:19.338911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58a1c4e8-f240-49c8-abb2-43883ad73167 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:19.482321 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-58a1c4e8-f240-49c8-abb2-43883ad73167 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:19.490195 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-58a1c4e8-f240-49c8-abb2-43883ad73167 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1679 microversion: 2.1 time: 0.174353 Aug 26 18:27:19.490736 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 268/536] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:19 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:19.698648 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-a572724d-da73-453d-8b8b-9a818415922d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:19.699210 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-a572724d-da73-453d-8b8b-9a818415922d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:19.706026 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a572724d-da73-453d-8b8b-9a818415922d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:19.706506 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a572724d-da73-453d-8b8b-9a818415922d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:19.706935 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a572724d-da73-453d-8b8b-9a818415922d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:19.707618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a572724d-da73-453d-8b8b-9a818415922d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:19.708058 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a572724d-da73-453d-8b8b-9a818415922d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:19.708464 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a572724d-da73-453d-8b8b-9a818415922d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:19.843658 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a572724d-da73-453d-8b8b-9a818415922d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:19.852536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-a572724d-da73-453d-8b8b-9a818415922d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.157967 Aug 26 18:27:19.853350 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 269/537] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:19 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:20.511821 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7dd60094-4a5f-451c-8fdf-61cc8723c758 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:20.512388 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7dd60094-4a5f-451c-8fdf-61cc8723c758 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:20.514691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=36 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:27:20.520472 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dd60094-4a5f-451c-8fdf-61cc8723c758 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:20.520981 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dd60094-4a5f-451c-8fdf-61cc8723c758 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:20.521881 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dd60094-4a5f-451c-8fdf-61cc8723c758 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:20.522597 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dd60094-4a5f-451c-8fdf-61cc8723c758 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:20.523270 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dd60094-4a5f-451c-8fdf-61cc8723c758 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:20.523445 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dd60094-4a5f-451c-8fdf-61cc8723c758 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:20.664467 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7dd60094-4a5f-451c-8fdf-61cc8723c758 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:20.677093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7dd60094-4a5f-451c-8fdf-61cc8723c758 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1679 microversion: 2.1 time: 0.169109 Aug 26 18:27:20.677966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 269/538] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:20 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:20.878254 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-fedd1b81-15d4-4c6b-8c86-edd02a2b1648 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:20.879248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-fedd1b81-15d4-4c6b-8c86-edd02a2b1648 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:20.890561 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fedd1b81-15d4-4c6b-8c86-edd02a2b1648 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:20.891351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fedd1b81-15d4-4c6b-8c86-edd02a2b1648 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:20.892071 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fedd1b81-15d4-4c6b-8c86-edd02a2b1648 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:20.893246 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fedd1b81-15d4-4c6b-8c86-edd02a2b1648 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:20.893990 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fedd1b81-15d4-4c6b-8c86-edd02a2b1648 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:20.894693 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fedd1b81-15d4-4c6b-8c86-edd02a2b1648 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:21.040411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-fedd1b81-15d4-4c6b-8c86-edd02a2b1648 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:21.048817 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-fedd1b81-15d4-4c6b-8c86-edd02a2b1648 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.177089 Aug 26 18:27:21.049413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 270/539] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:20 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:21.698949 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-683f6acd-c140-48f2-ac4a-c2b746461127 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:21.699538 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-683f6acd-c140-48f2-ac4a-c2b746461127 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:21.706580 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-683f6acd-c140-48f2-ac4a-c2b746461127 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:21.707067 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-683f6acd-c140-48f2-ac4a-c2b746461127 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:21.707498 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-683f6acd-c140-48f2-ac4a-c2b746461127 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:21.708192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-683f6acd-c140-48f2-ac4a-c2b746461127 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:21.708638 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-683f6acd-c140-48f2-ac4a-c2b746461127 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:21.709090 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-683f6acd-c140-48f2-ac4a-c2b746461127 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:21.852348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-683f6acd-c140-48f2-ac4a-c2b746461127 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:21.861011 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-683f6acd-c140-48f2-ac4a-c2b746461127 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1679 microversion: 2.1 time: 0.166001 Aug 26 18:27:21.861582 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 270/540] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:21 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:22.077946 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-cd2b820a-f27b-49ec-aba2-04834ef7d701 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:22.078524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-cd2b820a-f27b-49ec-aba2-04834ef7d701 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:22.085395 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cd2b820a-f27b-49ec-aba2-04834ef7d701 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:22.085886 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cd2b820a-f27b-49ec-aba2-04834ef7d701 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:22.086322 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cd2b820a-f27b-49ec-aba2-04834ef7d701 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:22.087022 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cd2b820a-f27b-49ec-aba2-04834ef7d701 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:22.087473 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cd2b820a-f27b-49ec-aba2-04834ef7d701 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:22.087999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cd2b820a-f27b-49ec-aba2-04834ef7d701 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:22.231220 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-cd2b820a-f27b-49ec-aba2-04834ef7d701 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:22.239990 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-cd2b820a-f27b-49ec-aba2-04834ef7d701 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.166063 Aug 26 18:27:22.240540 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 271/541] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:22 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:22.885831 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-547fc3cd-94d0-4d76-972a-1cec01a8750d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:22.886858 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-547fc3cd-94d0-4d76-972a-1cec01a8750d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:22.898225 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-547fc3cd-94d0-4d76-972a-1cec01a8750d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:22.898906 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-547fc3cd-94d0-4d76-972a-1cec01a8750d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:22.899618 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-547fc3cd-94d0-4d76-972a-1cec01a8750d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:22.900670 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-547fc3cd-94d0-4d76-972a-1cec01a8750d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:22.901107 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-547fc3cd-94d0-4d76-972a-1cec01a8750d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:22.901551 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-547fc3cd-94d0-4d76-972a-1cec01a8750d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:23.039654 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-547fc3cd-94d0-4d76-972a-1cec01a8750d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:23.047959 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-547fc3cd-94d0-4d76-972a-1cec01a8750d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1679 microversion: 2.1 time: 0.168762 Aug 26 18:27:23.048528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 271/542] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:22 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:23.261597 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4c03708d-179a-4ffa-83cd-761e1a907ed5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:23.262181 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4c03708d-179a-4ffa-83cd-761e1a907ed5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:23.269080 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4c03708d-179a-4ffa-83cd-761e1a907ed5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:23.269559 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4c03708d-179a-4ffa-83cd-761e1a907ed5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:23.269995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4c03708d-179a-4ffa-83cd-761e1a907ed5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:23.270683 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4c03708d-179a-4ffa-83cd-761e1a907ed5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:23.271126 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4c03708d-179a-4ffa-83cd-761e1a907ed5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:23.271871 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4c03708d-179a-4ffa-83cd-761e1a907ed5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:23.402520 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-4c03708d-179a-4ffa-83cd-761e1a907ed5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:23.410991 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4c03708d-179a-4ffa-83cd-761e1a907ed5 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.153319 Aug 26 18:27:23.411565 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 272/543] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:23 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:24.071940 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-549f284c-22de-4aeb-8db4-d016f70146b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:24.072909 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-549f284c-22de-4aeb-8db4-d016f70146b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:24.080213 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-549f284c-22de-4aeb-8db4-d016f70146b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:24.080703 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-549f284c-22de-4aeb-8db4-d016f70146b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:24.081159 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-549f284c-22de-4aeb-8db4-d016f70146b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:24.081858 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-549f284c-22de-4aeb-8db4-d016f70146b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:24.082308 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-549f284c-22de-4aeb-8db4-d016f70146b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:24.082728 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-549f284c-22de-4aeb-8db4-d016f70146b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:24.226692 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-549f284c-22de-4aeb-8db4-d016f70146b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:24.234956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-549f284c-22de-4aeb-8db4-d016f70146b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1679 microversion: 2.1 time: 0.167004 Aug 26 18:27:24.235534 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 272/544] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:24 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:24.433106 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-af53b8ab-fb9f-43a0-bc70-1b26a9a62d88 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:24.433663 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-af53b8ab-fb9f-43a0-bc70-1b26a9a62d88 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:24.440816 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-af53b8ab-fb9f-43a0-bc70-1b26a9a62d88 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:24.441303 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-af53b8ab-fb9f-43a0-bc70-1b26a9a62d88 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:24.441736 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-af53b8ab-fb9f-43a0-bc70-1b26a9a62d88 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:24.442457 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-af53b8ab-fb9f-43a0-bc70-1b26a9a62d88 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:24.442910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-af53b8ab-fb9f-43a0-bc70-1b26a9a62d88 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:24.443331 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-af53b8ab-fb9f-43a0-bc70-1b26a9a62d88 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:24.578891 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-af53b8ab-fb9f-43a0-bc70-1b26a9a62d88 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:24.587585 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-af53b8ab-fb9f-43a0-bc70-1b26a9a62d88 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.158633 Aug 26 18:27:24.588175 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 273/545] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:24 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:25.260270 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b2fbd78b-dff7-4052-b2fd-3036f7304ee2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:25.261329 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b2fbd78b-dff7-4052-b2fd-3036f7304ee2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:25.272485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2fbd78b-dff7-4052-b2fd-3036f7304ee2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:25.273458 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2fbd78b-dff7-4052-b2fd-3036f7304ee2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:25.274233 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2fbd78b-dff7-4052-b2fd-3036f7304ee2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:25.275384 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2fbd78b-dff7-4052-b2fd-3036f7304ee2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:25.276008 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2fbd78b-dff7-4052-b2fd-3036f7304ee2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:25.276436 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2fbd78b-dff7-4052-b2fd-3036f7304ee2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:25.419075 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b2fbd78b-dff7-4052-b2fd-3036f7304ee2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:25.431701 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b2fbd78b-dff7-4052-b2fd-3036f7304ee2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1679 microversion: 2.1 time: 0.177622 Aug 26 18:27:25.432506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 273/546] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:25 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:25.615538 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-94d845e5-7373-42a5-b313-12b9a1fe8fea tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:25.616051 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-94d845e5-7373-42a5-b313-12b9a1fe8fea tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:25.622751 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-94d845e5-7373-42a5-b313-12b9a1fe8fea tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:25.623234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-94d845e5-7373-42a5-b313-12b9a1fe8fea tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:25.623667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-94d845e5-7373-42a5-b313-12b9a1fe8fea tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:25.624379 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-94d845e5-7373-42a5-b313-12b9a1fe8fea tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:25.624857 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-94d845e5-7373-42a5-b313-12b9a1fe8fea tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:25.625277 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-94d845e5-7373-42a5-b313-12b9a1fe8fea tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:25.764010 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-94d845e5-7373-42a5-b313-12b9a1fe8fea tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:25.773054 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-94d845e5-7373-42a5-b313-12b9a1fe8fea tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.161601 Aug 26 18:27:25.773626 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 274/547] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:25 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:26.461895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-31902614-5397-4121-8712-5514a2a9227e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:26.462560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-31902614-5397-4121-8712-5514a2a9227e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:26.472227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31902614-5397-4121-8712-5514a2a9227e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:26.472935 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31902614-5397-4121-8712-5514a2a9227e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:26.473568 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31902614-5397-4121-8712-5514a2a9227e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:26.474497 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31902614-5397-4121-8712-5514a2a9227e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:26.475014 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31902614-5397-4121-8712-5514a2a9227e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:26.475718 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31902614-5397-4121-8712-5514a2a9227e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:26.614195 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-31902614-5397-4121-8712-5514a2a9227e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:26.622637 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-31902614-5397-4121-8712-5514a2a9227e tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1679 microversion: 2.1 time: 0.166249 Aug 26 18:27:26.623210 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 274/548] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:26 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:26.794782 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8e91c6de-2c34-4a22-bf70-08383501495f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:26.795397 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8e91c6de-2c34-4a22-bf70-08383501495f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:26.802150 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8e91c6de-2c34-4a22-bf70-08383501495f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:26.802671 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8e91c6de-2c34-4a22-bf70-08383501495f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:26.803105 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8e91c6de-2c34-4a22-bf70-08383501495f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:26.803839 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8e91c6de-2c34-4a22-bf70-08383501495f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:26.804402 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8e91c6de-2c34-4a22-bf70-08383501495f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:26.804846 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8e91c6de-2c34-4a22-bf70-08383501495f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:26.943932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8e91c6de-2c34-4a22-bf70-08383501495f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:26.952968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8e91c6de-2c34-4a22-bf70-08383501495f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.162255 Aug 26 18:27:26.953552 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 275/549] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:26 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:27.644213 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3c5e9096-311a-45f9-9c0b-7110890ea13f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:27.644857 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3c5e9096-311a-45f9-9c0b-7110890ea13f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:27.651956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c5e9096-311a-45f9-9c0b-7110890ea13f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:27.652442 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c5e9096-311a-45f9-9c0b-7110890ea13f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:27.652917 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c5e9096-311a-45f9-9c0b-7110890ea13f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:27.653609 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c5e9096-311a-45f9-9c0b-7110890ea13f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:27.654060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c5e9096-311a-45f9-9c0b-7110890ea13f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:27.654492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c5e9096-311a-45f9-9c0b-7110890ea13f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:27.793042 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3c5e9096-311a-45f9-9c0b-7110890ea13f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:27.801304 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3c5e9096-311a-45f9-9c0b-7110890ea13f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1656 microversion: 2.1 time: 0.161016 Aug 26 18:27:27.801879 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 275/550] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:27 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1656 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:27.823320 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c6ce7583-75f2-4737-87b0-33dcdc6c13e8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:27:27.830178 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6ce7583-75f2-4737-87b0-33dcdc6c13e8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:27.830688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6ce7583-75f2-4737-87b0-33dcdc6c13e8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:27.831120 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6ce7583-75f2-4737-87b0-33dcdc6c13e8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:27.853939 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c6ce7583-75f2-4737-87b0-33dcdc6c13e8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Going to try to start instance {{(pid=120540) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 18:27:27.858549 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:27:27.900589 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c6ce7583-75f2-4737-87b0-33dcdc6c13e8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "POST /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/action" status: 202 len: 0 microversion: 2.1 time: 0.082080 Aug 26 18:27:27.901268 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 276/551] 10.222.0.45 () {60 vars in 1278 bytes} [Fri Aug 26 18:27:27 2022] POST /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:27:27.909547 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-447684c3-5afa-4365-92e4-303704d0aea7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:27.910153 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-447684c3-5afa-4365-92e4-303704d0aea7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:27.916272 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-447684c3-5afa-4365-92e4-303704d0aea7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:27.916805 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-447684c3-5afa-4365-92e4-303704d0aea7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:27.917261 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-447684c3-5afa-4365-92e4-303704d0aea7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:27.917943 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-447684c3-5afa-4365-92e4-303704d0aea7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:27.918393 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-447684c3-5afa-4365-92e4-303704d0aea7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:27.918814 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-447684c3-5afa-4365-92e4-303704d0aea7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:27.975421 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-6c162fa2-b6c7-4b2b-9d7c-56bc56bc3358 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:27.976022 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-6c162fa2-b6c7-4b2b-9d7c-56bc56bc3358 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:27.983386 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c162fa2-b6c7-4b2b-9d7c-56bc56bc3358 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:27.983947 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c162fa2-b6c7-4b2b-9d7c-56bc56bc3358 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:27.984484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c162fa2-b6c7-4b2b-9d7c-56bc56bc3358 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:27.985278 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c162fa2-b6c7-4b2b-9d7c-56bc56bc3358 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:27.985799 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c162fa2-b6c7-4b2b-9d7c-56bc56bc3358 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:27.986221 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c162fa2-b6c7-4b2b-9d7c-56bc56bc3358 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:28.058560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-447684c3-5afa-4365-92e4-303704d0aea7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:28.066617 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-447684c3-5afa-4365-92e4-303704d0aea7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1665 microversion: 2.1 time: 0.160962 Aug 26 18:27:28.067196 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 276/552] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:27 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:28.121608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6c162fa2-b6c7-4b2b-9d7c-56bc56bc3358 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:28.129967 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-6c162fa2-b6c7-4b2b-9d7c-56bc56bc3358 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.159184 Aug 26 18:27:28.130551 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 277/553] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:27 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:29.087974 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-14740d38-da71-4f63-a298-a11ecc30e56f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:29.088553 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-14740d38-da71-4f63-a298-a11ecc30e56f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:29.096003 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14740d38-da71-4f63-a298-a11ecc30e56f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:29.096516 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14740d38-da71-4f63-a298-a11ecc30e56f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:29.096994 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14740d38-da71-4f63-a298-a11ecc30e56f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:29.097718 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14740d38-da71-4f63-a298-a11ecc30e56f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:29.098156 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14740d38-da71-4f63-a298-a11ecc30e56f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:29.098581 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14740d38-da71-4f63-a298-a11ecc30e56f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:29.151940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-dfba42bd-e325-4275-b4a6-1908c9d66397 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:29.152599 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-dfba42bd-e325-4275-b4a6-1908c9d66397 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:29.159891 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dfba42bd-e325-4275-b4a6-1908c9d66397 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:29.160395 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dfba42bd-e325-4275-b4a6-1908c9d66397 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:29.160855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dfba42bd-e325-4275-b4a6-1908c9d66397 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:29.161604 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dfba42bd-e325-4275-b4a6-1908c9d66397 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:29.162028 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dfba42bd-e325-4275-b4a6-1908c9d66397 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:29.162486 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dfba42bd-e325-4275-b4a6-1908c9d66397 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:29.235847 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-14740d38-da71-4f63-a298-a11ecc30e56f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:29.243975 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-14740d38-da71-4f63-a298-a11ecc30e56f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1665 microversion: 2.1 time: 0.160092 Aug 26 18:27:29.244549 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 277/554] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:29 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:29.304493 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-dfba42bd-e325-4275-b4a6-1908c9d66397 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:29.314572 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-dfba42bd-e325-4275-b4a6-1908c9d66397 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.166547 Aug 26 18:27:29.315248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 278/555] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:29 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:27:30.265138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f7cbf29e-4ce3-4c15-9ea4-4c38838e5111 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:30.265754 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f7cbf29e-4ce3-4c15-9ea4-4c38838e5111 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:30.272699 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7cbf29e-4ce3-4c15-9ea4-4c38838e5111 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:30.273224 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7cbf29e-4ce3-4c15-9ea4-4c38838e5111 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:30.273657 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7cbf29e-4ce3-4c15-9ea4-4c38838e5111 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:30.274362 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7cbf29e-4ce3-4c15-9ea4-4c38838e5111 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:30.274826 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7cbf29e-4ce3-4c15-9ea4-4c38838e5111 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:30.275253 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7cbf29e-4ce3-4c15-9ea4-4c38838e5111 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:30.338165 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-578833f6-e6e6-4841-8535-0644d7f97c8b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:30.339097 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-578833f6-e6e6-4841-8535-0644d7f97c8b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:30.345729 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-578833f6-e6e6-4841-8535-0644d7f97c8b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:30.346271 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-578833f6-e6e6-4841-8535-0644d7f97c8b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:30.346669 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-578833f6-e6e6-4841-8535-0644d7f97c8b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:30.347361 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-578833f6-e6e6-4841-8535-0644d7f97c8b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:30.347842 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-578833f6-e6e6-4841-8535-0644d7f97c8b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:30.348257 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-578833f6-e6e6-4841-8535-0644d7f97c8b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:30.411322 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f7cbf29e-4ce3-4c15-9ea4-4c38838e5111 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:30.420271 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f7cbf29e-4ce3-4c15-9ea4-4c38838e5111 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1665 microversion: 2.1 time: 0.159100 Aug 26 18:27:30.420899 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 278/556] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:30 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:30.542277 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-578833f6-e6e6-4841-8535-0644d7f97c8b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:30.550999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-578833f6-e6e6-4841-8535-0644d7f97c8b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.217577 Aug 26 18:27:30.551597 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 279/557] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:30 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:31.440992 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d08c266e-6f8a-4945-9349-0b3054e3c69b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:31.441601 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d08c266e-6f8a-4945-9349-0b3054e3c69b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:31.448065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d08c266e-6f8a-4945-9349-0b3054e3c69b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:31.448545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d08c266e-6f8a-4945-9349-0b3054e3c69b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:31.449025 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d08c266e-6f8a-4945-9349-0b3054e3c69b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:31.449713 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d08c266e-6f8a-4945-9349-0b3054e3c69b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:31.450162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d08c266e-6f8a-4945-9349-0b3054e3c69b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:31.450581 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d08c266e-6f8a-4945-9349-0b3054e3c69b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:31.572428 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-20a67cf4-bff0-4a68-8057-9af37f49c0be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:31.573065 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-20a67cf4-bff0-4a68-8057-9af37f49c0be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:31.580042 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20a67cf4-bff0-4a68-8057-9af37f49c0be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:31.580548 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20a67cf4-bff0-4a68-8057-9af37f49c0be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:31.581001 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20a67cf4-bff0-4a68-8057-9af37f49c0be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:31.581701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20a67cf4-bff0-4a68-8057-9af37f49c0be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:31.582170 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20a67cf4-bff0-4a68-8057-9af37f49c0be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:31.582584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-20a67cf4-bff0-4a68-8057-9af37f49c0be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:31.585977 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d08c266e-6f8a-4945-9349-0b3054e3c69b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:31.594170 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d08c266e-6f8a-4945-9349-0b3054e3c69b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1665 microversion: 2.1 time: 0.157457 Aug 26 18:27:31.594766 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 279/558] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:31 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:31.719486 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-20a67cf4-bff0-4a68-8057-9af37f49c0be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:31.728616 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-20a67cf4-bff0-4a68-8057-9af37f49c0be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.160357 Aug 26 18:27:31.729402 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 280/559] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:31 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:32.615300 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e4b65db1-c406-4436-8b72-60dfd4011de9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:32.615926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e4b65db1-c406-4436-8b72-60dfd4011de9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:32.623156 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4b65db1-c406-4436-8b72-60dfd4011de9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:32.623747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4b65db1-c406-4436-8b72-60dfd4011de9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:32.624250 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4b65db1-c406-4436-8b72-60dfd4011de9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:32.625056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4b65db1-c406-4436-8b72-60dfd4011de9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:32.625542 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4b65db1-c406-4436-8b72-60dfd4011de9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:32.626011 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4b65db1-c406-4436-8b72-60dfd4011de9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:32.756121 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f412f68b-cae8-48b1-bca3-bf34cf897377 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:32.756575 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f412f68b-cae8-48b1-bca3-bf34cf897377 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:32.758484 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e4b65db1-c406-4436-8b72-60dfd4011de9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:32.763259 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f412f68b-cae8-48b1-bca3-bf34cf897377 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:32.763742 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f412f68b-cae8-48b1-bca3-bf34cf897377 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:32.764173 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f412f68b-cae8-48b1-bca3-bf34cf897377 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:32.764897 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f412f68b-cae8-48b1-bca3-bf34cf897377 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:32.765347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f412f68b-cae8-48b1-bca3-bf34cf897377 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:32.765761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f412f68b-cae8-48b1-bca3-bf34cf897377 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:32.766562 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e4b65db1-c406-4436-8b72-60dfd4011de9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1669 microversion: 2.1 time: 0.155489 Aug 26 18:27:32.767127 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 280/560] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:32 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:32.902031 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f412f68b-cae8-48b1-bca3-bf34cf897377 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:32.911292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f412f68b-cae8-48b1-bca3-bf34cf897377 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.159256 Aug 26 18:27:32.911898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 281/561] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:32 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:33.933310 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-de5cfae7-709a-4e2d-b201-e319d11f3957 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:33.933931 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-de5cfae7-709a-4e2d-b201-e319d11f3957 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:33.940974 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de5cfae7-709a-4e2d-b201-e319d11f3957 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:33.941457 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de5cfae7-709a-4e2d-b201-e319d11f3957 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:33.941875 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de5cfae7-709a-4e2d-b201-e319d11f3957 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:33.942562 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de5cfae7-709a-4e2d-b201-e319d11f3957 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:33.943011 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de5cfae7-709a-4e2d-b201-e319d11f3957 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:33.943430 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de5cfae7-709a-4e2d-b201-e319d11f3957 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:34.074983 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-de5cfae7-709a-4e2d-b201-e319d11f3957 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:34.083335 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-de5cfae7-709a-4e2d-b201-e319d11f3957 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.154156 Aug 26 18:27:34.083898 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 281/562] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:33 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:34.241576 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-796ce53e-855b-4f6c-a588-2f77314108a3 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:34.242122 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-796ce53e-855b-4f6c-a588-2f77314108a3 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:34.248218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-796ce53e-855b-4f6c-a588-2f77314108a3 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:34.248710 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-796ce53e-855b-4f6c-a588-2f77314108a3 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:34.249167 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-796ce53e-855b-4f6c-a588-2f77314108a3 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:34.249856 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-796ce53e-855b-4f6c-a588-2f77314108a3 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:34.250294 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-796ce53e-855b-4f6c-a588-2f77314108a3 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:34.250702 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-796ce53e-855b-4f6c-a588-2f77314108a3 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:34.335576 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-796ce53e-855b-4f6c-a588-2f77314108a3 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lazy-loading 'services' on Instance uuid b8e9779b-006a-442f-9366-98ffc1100058 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:27:34.412044 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-796ce53e-855b-4f6c-a588-2f77314108a3 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058/os-volume_attachments/11db7da3-b1a3-4e57-a628-621bba591f08" status: 202 len: 0 microversion: 2.1 time: 0.174442 Aug 26 18:27:34.412647 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 282/563] 10.222.0.45 () {58 vars in 1416 bytes} [Fri Aug 26 18:27:34 2022] DELETE /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058/os-volume_attachments/11db7da3-b1a3-4e57-a628-621bba591f08 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:27:35.105892 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-894f91f2-51a8-47df-9585-e5c9eb1d7516 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:35.106520 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-894f91f2-51a8-47df-9585-e5c9eb1d7516 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:35.113537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-894f91f2-51a8-47df-9585-e5c9eb1d7516 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:35.114015 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-894f91f2-51a8-47df-9585-e5c9eb1d7516 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:35.114441 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-894f91f2-51a8-47df-9585-e5c9eb1d7516 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:35.115123 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-894f91f2-51a8-47df-9585-e5c9eb1d7516 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:35.115569 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-894f91f2-51a8-47df-9585-e5c9eb1d7516 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:35.115983 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-894f91f2-51a8-47df-9585-e5c9eb1d7516 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:35.250692 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-894f91f2-51a8-47df-9585-e5c9eb1d7516 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:35.259464 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-894f91f2-51a8-47df-9585-e5c9eb1d7516 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1737 microversion: 2.1 time: 0.157908 Aug 26 18:27:35.260056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 282/564] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:35 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:36.285461 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8a28b409-9bf8-41dc-974f-7d3ffcf9274f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:36.286257 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8a28b409-9bf8-41dc-974f-7d3ffcf9274f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:36.294977 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8a28b409-9bf8-41dc-974f-7d3ffcf9274f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:36.295455 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8a28b409-9bf8-41dc-974f-7d3ffcf9274f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:36.295878 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8a28b409-9bf8-41dc-974f-7d3ffcf9274f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:36.296573 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8a28b409-9bf8-41dc-974f-7d3ffcf9274f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:36.297030 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8a28b409-9bf8-41dc-974f-7d3ffcf9274f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:36.297412 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8a28b409-9bf8-41dc-974f-7d3ffcf9274f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:36.440221 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8a28b409-9bf8-41dc-974f-7d3ffcf9274f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:36.448873 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8a28b409-9bf8-41dc-974f-7d3ffcf9274f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1717 microversion: 2.1 time: 0.171015 Aug 26 18:27:36.449465 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 283/565] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:36 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1717 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:36.575892 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f8581063-47f7-434a-8b43-161674182267 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:36.576409 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f8581063-47f7-434a-8b43-161674182267 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:36.583075 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8581063-47f7-434a-8b43-161674182267 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:36.583533 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8581063-47f7-434a-8b43-161674182267 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:36.584234 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8581063-47f7-434a-8b43-161674182267 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:36.584943 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8581063-47f7-434a-8b43-161674182267 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:36.585451 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8581063-47f7-434a-8b43-161674182267 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:36.585785 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8581063-47f7-434a-8b43-161674182267 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:36.716517 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-f8581063-47f7-434a-8b43-161674182267 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] HTTP exception thrown: Cannot 'detach_volume' instance 64b399c3-d3a3-4193-9826-e509b3b9b529 while it is in vm_state rescued Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f8581063-47f7-434a-8b43-161674182267 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Request method failure captured: Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments/fee8972f-344e-4b3f-a6b0-6312a3cc2ffb HTTP/1.1 Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ-q3zm4iqYsaqe6bB_XUaX46zVzzw5UqiDi0-NWNM8uHB_C5he6uznHk9eGLXg2ymLBubpgUrHzXL84c_lo2S7oVUjU4Q0PoVOxgY1frPPZbjfxZpPuL-Bvosu5RLz3DtLT6Icwl-SAd9UlXmMJkuBN-9ExPAx31BGg6XtRADVIRq0 Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 1a8356be55fb4b19a95da8b77c6e2f9a Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1193523936 Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:27:36.718162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:27:36.719682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1a8356be55fb4b19a95da8b77c6e2f9a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1a8356be55fb4b19a95da8b77c6e2f9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1a8356be55fb4b19a95da8b77c6e2f9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1a8356be55fb4b19a95da8b77c6e2f9a"}]}] Aug 26 18:27:36.719682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1193523936 Aug 26 18:27:36.719682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 1a8356be55fb4b19a95da8b77c6e2f9a Aug 26 18:27:36.719682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1193523936 Aug 26 18:27:36.719682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-ServerRescueNegativeTestJSON-1193523936-project Aug 26 18:27:36.719682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:27:36.719682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:27:36.719682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: c78657cb0d4144cfaf0a7be1e3388ed0 Aug 26 18:27:36.719682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1193523936-project Aug 26 18:27:36.719682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:27:36.719682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Cannot 'detach_volume' instance 64b399c3-d3a3-4193-9826-e509b3b9b529 while it is in vm_state rescued Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'server_id': '64b399c3-d3a3-4193-9826-e509b3b9b529', 'id': 'fee8972f-344e-4b3f-a6b0-6312a3cc2ffb'} Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 64b399c3-d3a3-4193-9826-e509b3b9b529 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:27:36.720502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 64b399c3-d3a3-4193-9826-e509b3b9b529 while it is in vm_state rescued Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 64b399c3-d3a3-4193-9826-e509b3b9b529 while it is in vm_state rescued Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:27:36.721839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f8581063-47f7-434a-8b43-161674182267 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Returning 409 to user: Cannot 'detach_volume' instance 64b399c3-d3a3-4193-9826-e509b3b9b529 while it is in vm_state rescued {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:27:36.722811 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f8581063-47f7-434a-8b43-161674182267 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "DELETE /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments/fee8972f-344e-4b3f-a6b0-6312a3cc2ffb" status: 409 len: 152 microversion: 2.1 time: 0.147867 Aug 26 18:27:36.722811 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 283/566] 10.222.0.45 () {58 vars in 1416 bytes} [Fri Aug 26 18:27:36 2022] DELETE /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments/fee8972f-344e-4b3f-a6b0-6312a3cc2ffb => generated 152 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 26 18:27:36.728989 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c5d577d2-a3a9-4324-9a70-159a660e5921 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:27:36.729527 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c5d577d2-a3a9-4324-9a70-159a660e5921 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:36.735652 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c5d577d2-a3a9-4324-9a70-159a660e5921 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:36.736133 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c5d577d2-a3a9-4324-9a70-159a660e5921 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:36.736565 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c5d577d2-a3a9-4324-9a70-159a660e5921 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:36.737286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c5d577d2-a3a9-4324-9a70-159a660e5921 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:36.737757 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c5d577d2-a3a9-4324-9a70-159a660e5921 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:36.738236 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c5d577d2-a3a9-4324-9a70-159a660e5921 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:36.810980 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c5d577d2-a3a9-4324-9a70-159a660e5921 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "POST /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/action" status: 202 len: 0 microversion: 2.1 time: 0.085823 Aug 26 18:27:36.814852 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 284/567] 10.222.0.45 () {60 vars in 1278 bytes} [Fri Aug 26 18:27:36 2022] POST /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 18:27:36.821939 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0db7e011-c577-491a-bc12-a25470652286 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:36.822734 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0db7e011-c577-491a-bc12-a25470652286 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:36.836659 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0db7e011-c577-491a-bc12-a25470652286 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:36.837307 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0db7e011-c577-491a-bc12-a25470652286 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:36.837810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0db7e011-c577-491a-bc12-a25470652286 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:36.838651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0db7e011-c577-491a-bc12-a25470652286 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:36.839182 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0db7e011-c577-491a-bc12-a25470652286 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:36.839706 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0db7e011-c577-491a-bc12-a25470652286 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:36.856313 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:27:36.973072 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0db7e011-c577-491a-bc12-a25470652286 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:36.982749 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0db7e011-c577-491a-bc12-a25470652286 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1725 microversion: 2.1 time: 0.166477 Aug 26 18:27:36.983396 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 284/568] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:36 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:27:37.660534 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-6686242b-2eed-443b-ac7b-111ea7ecce44 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:37.661146 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-6686242b-2eed-443b-ac7b-111ea7ecce44 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:37.667352 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6686242b-2eed-443b-ac7b-111ea7ecce44 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:37.667831 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6686242b-2eed-443b-ac7b-111ea7ecce44 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:37.668265 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6686242b-2eed-443b-ac7b-111ea7ecce44 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:37.668984 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6686242b-2eed-443b-ac7b-111ea7ecce44 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:37.669434 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6686242b-2eed-443b-ac7b-111ea7ecce44 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:37.669854 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6686242b-2eed-443b-ac7b-111ea7ecce44 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:37.694819 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-6686242b-2eed-443b-ac7b-111ea7ecce44 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Going to try to terminate instance {{(pid=120540) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:27:37.773935 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-6686242b-2eed-443b-ac7b-111ea7ecce44 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 204 len: 0 microversion: 2.1 time: 0.117418 Aug 26 18:27:37.774884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 285/569] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:27:37 2022] DELETE /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:27:37.783191 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a9546253-052e-45fd-878c-ae60685cba57 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:37.783816 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a9546253-052e-45fd-878c-ae60685cba57 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:37.790644 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9546253-052e-45fd-878c-ae60685cba57 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:37.791130 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9546253-052e-45fd-878c-ae60685cba57 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:37.791565 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9546253-052e-45fd-878c-ae60685cba57 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:37.792254 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9546253-052e-45fd-878c-ae60685cba57 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:37.792704 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9546253-052e-45fd-878c-ae60685cba57 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:37.793155 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9546253-052e-45fd-878c-ae60685cba57 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:37.930346 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a9546253-052e-45fd-878c-ae60685cba57 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:37.938328 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a9546253-052e-45fd-878c-ae60685cba57 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1514 microversion: 2.1 time: 0.158975 Aug 26 18:27:37.938892 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 285/570] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:37 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:38.004251 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9289d646-c654-43ad-958c-c173240bec11 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:38.004976 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9289d646-c654-43ad-958c-c173240bec11 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:38.011753 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9289d646-c654-43ad-958c-c173240bec11 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:38.012140 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9289d646-c654-43ad-958c-c173240bec11 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:38.012889 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9289d646-c654-43ad-958c-c173240bec11 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:38.013416 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9289d646-c654-43ad-958c-c173240bec11 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:38.013823 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9289d646-c654-43ad-958c-c173240bec11 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:38.014439 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9289d646-c654-43ad-958c-c173240bec11 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:38.147840 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9289d646-c654-43ad-958c-c173240bec11 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:38.156452 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9289d646-c654-43ad-958c-c173240bec11 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1725 microversion: 2.1 time: 0.156441 Aug 26 18:27:38.157037 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 286/571] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:37 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:38.959666 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f447b6cd-fed6-4c53-9f95-862a71d8bea9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:38.960265 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f447b6cd-fed6-4c53-9f95-862a71d8bea9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:38.967157 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f447b6cd-fed6-4c53-9f95-862a71d8bea9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:38.967635 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f447b6cd-fed6-4c53-9f95-862a71d8bea9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:38.968066 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f447b6cd-fed6-4c53-9f95-862a71d8bea9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:38.968756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f447b6cd-fed6-4c53-9f95-862a71d8bea9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:38.969298 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f447b6cd-fed6-4c53-9f95-862a71d8bea9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:38.969714 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f447b6cd-fed6-4c53-9f95-862a71d8bea9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:39.097619 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f447b6cd-fed6-4c53-9f95-862a71d8bea9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:39.105495 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f447b6cd-fed6-4c53-9f95-862a71d8bea9 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1514 microversion: 2.1 time: 0.149729 Aug 26 18:27:39.106069 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 286/572] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:38 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:39.178210 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-137bbda1-8176-46db-b7de-a38862dbcab1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:39.178914 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-137bbda1-8176-46db-b7de-a38862dbcab1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:39.185722 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-137bbda1-8176-46db-b7de-a38862dbcab1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:39.186203 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-137bbda1-8176-46db-b7de-a38862dbcab1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:39.186635 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-137bbda1-8176-46db-b7de-a38862dbcab1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:39.187318 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-137bbda1-8176-46db-b7de-a38862dbcab1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:39.187764 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-137bbda1-8176-46db-b7de-a38862dbcab1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:39.188187 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-137bbda1-8176-46db-b7de-a38862dbcab1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:39.315250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-137bbda1-8176-46db-b7de-a38862dbcab1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:39.324087 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-137bbda1-8176-46db-b7de-a38862dbcab1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1725 microversion: 2.1 time: 0.149799 Aug 26 18:27:39.324657 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 287/573] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:39 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:40.128910 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fa34c6f2-1ec2-4207-b981-e5d96b45fb7e tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:40.129537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fa34c6f2-1ec2-4207-b981-e5d96b45fb7e tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:40.135930 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa34c6f2-1ec2-4207-b981-e5d96b45fb7e tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:40.136468 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa34c6f2-1ec2-4207-b981-e5d96b45fb7e tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:40.136944 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa34c6f2-1ec2-4207-b981-e5d96b45fb7e tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:40.137627 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa34c6f2-1ec2-4207-b981-e5d96b45fb7e tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:40.138267 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa34c6f2-1ec2-4207-b981-e5d96b45fb7e tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:40.138685 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa34c6f2-1ec2-4207-b981-e5d96b45fb7e tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:40.272925 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fa34c6f2-1ec2-4207-b981-e5d96b45fb7e tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:40.280868 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fa34c6f2-1ec2-4207-b981-e5d96b45fb7e tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1514 microversion: 2.1 time: 0.157780 Aug 26 18:27:40.281428 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 287/574] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:40 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:40.346344 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e78043d0-4fb3-4e8f-91fe-408a096234f0 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:40.346841 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e78043d0-4fb3-4e8f-91fe-408a096234f0 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:40.353480 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e78043d0-4fb3-4e8f-91fe-408a096234f0 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:40.353964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e78043d0-4fb3-4e8f-91fe-408a096234f0 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:40.354391 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e78043d0-4fb3-4e8f-91fe-408a096234f0 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:40.355111 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e78043d0-4fb3-4e8f-91fe-408a096234f0 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:40.355555 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e78043d0-4fb3-4e8f-91fe-408a096234f0 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:40.355995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e78043d0-4fb3-4e8f-91fe-408a096234f0 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:40.491295 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e78043d0-4fb3-4e8f-91fe-408a096234f0 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:40.499980 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e78043d0-4fb3-4e8f-91fe-408a096234f0 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1725 microversion: 2.1 time: 0.157779 Aug 26 18:27:40.500562 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 288/575] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:40 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:41.302368 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3812cfd8-1e79-4a66-af7d-d7ea9eb29019 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:41.302951 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3812cfd8-1e79-4a66-af7d-d7ea9eb29019 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:41.310151 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3812cfd8-1e79-4a66-af7d-d7ea9eb29019 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:41.310626 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3812cfd8-1e79-4a66-af7d-d7ea9eb29019 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:41.311087 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3812cfd8-1e79-4a66-af7d-d7ea9eb29019 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:41.311780 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3812cfd8-1e79-4a66-af7d-d7ea9eb29019 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:41.312226 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3812cfd8-1e79-4a66-af7d-d7ea9eb29019 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:41.312641 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3812cfd8-1e79-4a66-af7d-d7ea9eb29019 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:41.442273 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3812cfd8-1e79-4a66-af7d-d7ea9eb29019 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:41.450258 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3812cfd8-1e79-4a66-af7d-d7ea9eb29019 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1514 microversion: 2.1 time: 0.151989 Aug 26 18:27:41.450857 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 288/576] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:41 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:41.521190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-63e838fe-62a5-4755-9c6e-9e2263c94482 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:41.521778 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-63e838fe-62a5-4755-9c6e-9e2263c94482 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:41.529394 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63e838fe-62a5-4755-9c6e-9e2263c94482 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:41.529898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63e838fe-62a5-4755-9c6e-9e2263c94482 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:41.530331 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63e838fe-62a5-4755-9c6e-9e2263c94482 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:41.531035 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63e838fe-62a5-4755-9c6e-9e2263c94482 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:41.531497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63e838fe-62a5-4755-9c6e-9e2263c94482 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:41.531913 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63e838fe-62a5-4755-9c6e-9e2263c94482 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:41.537154 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:27:41.753596 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-63e838fe-62a5-4755-9c6e-9e2263c94482 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:41.762560 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-63e838fe-62a5-4755-9c6e-9e2263c94482 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1725 microversion: 2.1 time: 0.245367 Aug 26 18:27:41.763283 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 289/577] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:41 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:41.973851 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-6aaff9dc-c8e7-44a7-9a96-830010d6f9c0 req-f2ebf3e9-e1f1-468c-ac3f-1ae5f25b5349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e9779b-006a-442f-9366-98ffc1100058", "name": "network-vif-deleted", "tag": "f7776dfc-a6d2-423e-adaa-bd983a3e8253"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:27:41.985048 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-6aaff9dc-c8e7-44a7-9a96-830010d6f9c0 req-f2ebf3e9-e1f1-468c-ac3f-1ae5f25b5349 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:41.985540 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-6aaff9dc-c8e7-44a7-9a96-830010d6f9c0 req-f2ebf3e9-e1f1-468c-ac3f-1ae5f25b5349 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:41.985940 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-6aaff9dc-c8e7-44a7-9a96-830010d6f9c0 req-f2ebf3e9-e1f1-468c-ac3f-1ae5f25b5349 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:41.998719 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-6aaff9dc-c8e7-44a7-9a96-830010d6f9c0 req-f2ebf3e9-e1f1-468c-ac3f-1ae5f25b5349 service nova] Creating event network-vif-deleted:f7776dfc-a6d2-423e-adaa-bd983a3e8253 for instance b8e9779b-006a-442f-9366-98ffc1100058 on hv-cinder-85199 Aug 26 18:27:42.003689 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-6aaff9dc-c8e7-44a7-9a96-830010d6f9c0 req-f2ebf3e9-e1f1-468c-ac3f-1ae5f25b5349 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033577 Aug 26 18:27:42.004324 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 289/578] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:27:42.470815 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-b3fdc685-b8ee-4ddb-abee-68a3dfb7e7b7 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:42.471420 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-b3fdc685-b8ee-4ddb-abee-68a3dfb7e7b7 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:42.478749 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3fdc685-b8ee-4ddb-abee-68a3dfb7e7b7 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:42.479278 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3fdc685-b8ee-4ddb-abee-68a3dfb7e7b7 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:42.479712 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3fdc685-b8ee-4ddb-abee-68a3dfb7e7b7 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:42.480421 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3fdc685-b8ee-4ddb-abee-68a3dfb7e7b7 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:42.480879 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3fdc685-b8ee-4ddb-abee-68a3dfb7e7b7 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:42.481379 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3fdc685-b8ee-4ddb-abee-68a3dfb7e7b7 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:42.516518 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3fdc685-b8ee-4ddb-abee-68a3dfb7e7b7 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:42.517044 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3fdc685-b8ee-4ddb-abee-68a3dfb7e7b7 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:42.517475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3fdc685-b8ee-4ddb-abee-68a3dfb7e7b7 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:42.517930 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-b3fdc685-b8ee-4ddb-abee-68a3dfb7e7b7 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lazy-loading 'fault' on Instance uuid b8e9779b-006a-442f-9366-98ffc1100058 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:27:42.567784 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b3fdc685-b8ee-4ddb-abee-68a3dfb7e7b7 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:42.575890 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-b3fdc685-b8ee-4ddb-abee-68a3dfb7e7b7 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 200 len: 1309 microversion: 2.1 time: 0.108883 Aug 26 18:27:42.576407 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 290/579] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:42 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:42.787254 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4d7db72f-5804-4e9a-afe4-0ded9a0a368b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:42.787809 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4d7db72f-5804-4e9a-afe4-0ded9a0a368b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:42.794927 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d7db72f-5804-4e9a-afe4-0ded9a0a368b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:42.795407 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d7db72f-5804-4e9a-afe4-0ded9a0a368b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:42.795835 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d7db72f-5804-4e9a-afe4-0ded9a0a368b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:42.796547 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d7db72f-5804-4e9a-afe4-0ded9a0a368b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:42.796989 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d7db72f-5804-4e9a-afe4-0ded9a0a368b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:42.797435 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d7db72f-5804-4e9a-afe4-0ded9a0a368b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:42.947153 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4d7db72f-5804-4e9a-afe4-0ded9a0a368b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:42.957186 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4d7db72f-5804-4e9a-afe4-0ded9a0a368b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1731 microversion: 2.1 time: 0.175217 Aug 26 18:27:42.957798 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 290/580] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:42 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:42.979884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-63822647-6848-489b-9418-4d74a7a81511 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:42.980399 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-63822647-6848-489b-9418-4d74a7a81511 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:42.987509 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63822647-6848-489b-9418-4d74a7a81511 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:42.987994 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63822647-6848-489b-9418-4d74a7a81511 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:42.988463 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63822647-6848-489b-9418-4d74a7a81511 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:42.989380 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63822647-6848-489b-9418-4d74a7a81511 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:42.990122 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63822647-6848-489b-9418-4d74a7a81511 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:42.990721 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63822647-6848-489b-9418-4d74a7a81511 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:43.271728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-63822647-6848-489b-9418-4d74a7a81511 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.296158 Aug 26 18:27:43.272755 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 291/581] 10.222.0.45 () {58 vars in 1275 bytes} [Fri Aug 26 18:27:42 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-interface => generated 284 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:27:43.596602 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2011011c-3a4f-4568-bec9-35b81fa0eb88 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:43.597315 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2011011c-3a4f-4568-bec9-35b81fa0eb88 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: b8e9779b-006a-442f-9366-98ffc1100058] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:43.603470 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2011011c-3a4f-4568-bec9-35b81fa0eb88 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:43.603930 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2011011c-3a4f-4568-bec9-35b81fa0eb88 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:43.604391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2011011c-3a4f-4568-bec9-35b81fa0eb88 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:43.605122 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2011011c-3a4f-4568-bec9-35b81fa0eb88 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:43.605568 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2011011c-3a4f-4568-bec9-35b81fa0eb88 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:43.605984 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2011011c-3a4f-4568-bec9-35b81fa0eb88 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:43.624679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-2011011c-3a4f-4568-bec9-35b81fa0eb88 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] HTTP exception thrown: Instance b8e9779b-006a-442f-9366-98ffc1100058 could not be found. Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2011011c-3a4f-4568-bec9-35b81fa0eb88 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Request method failure captured: Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 HTTP/1.1 Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCRBTCyyME1hxnmQ5axDEq7BFAqYpEU2Q3nwQo-781sJNZwSpi8OWUV7i2qujm4ijMW3_Q7jrFKabCzhykEclIl1_cX7JSghWm7_9Kof7ux_rZpBcPGDi-jIDcUlJXyhZXgAozm5a4pxyh2zZ70cDdpwYP5WsB7BnxPt1kNKthUaPsv8 Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: e19db2164fb9439c8b079f2baf661b40 Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesSnapshotTestJSON-60066652 Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:27:43.626369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:27:43.627784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e19db2164fb9439c8b079f2baf661b40", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e19db2164fb9439c8b079f2baf661b40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e19db2164fb9439c8b079f2baf661b40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e19db2164fb9439c8b079f2baf661b40"}]}] Aug 26 18:27:43.627784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesSnapshotTestJSON-60066652 Aug 26 18:27:43.627784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: e19db2164fb9439c8b079f2baf661b40 Aug 26 18:27:43.627784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-60066652 Aug 26 18:27:43.627784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesSnapshotTestJSON-60066652-project Aug 26 18:27:43.627784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:27:43.627784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:27:43.627784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: 6a8b301eeb0c4cbda40494e57ba78e52 Aug 26 18:27:43.627784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesSnapshotTestJSON-60066652-project Aug 26 18:27:43.627784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:27:43.627784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance b8e9779b-006a-442f-9366-98ffc1100058 could not be found. Aug 26 18:27:43.627784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': 'b8e9779b-006a-442f-9366-98ffc1100058'} Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8e9779b-006a-442f-9366-98ffc1100058 could not be found. Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:27:43.628528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8e9779b-006a-442f-9366-98ffc1100058 could not be found. Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8e9779b-006a-442f-9366-98ffc1100058 could not be found. Aug 26 18:27:43.629737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:27:43.630843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2011011c-3a4f-4568-bec9-35b81fa0eb88 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Returning 404 to user: Instance b8e9779b-006a-442f-9366-98ffc1100058 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:27:43.630843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2011011c-3a4f-4568-bec9-35b81fa0eb88 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058" status: 404 len: 111 microversion: 2.1 time: 0.035190 Aug 26 18:27:43.630843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 291/582] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:43 2022] GET /compute/v2.1/servers/b8e9779b-006a-442f-9366-98ffc1100058 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:27:44.194485 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-0accb8d9-0a06-4906-b5f2-cdbd68992254 req-012dd191-66ea-4a2f-9e9a-9b9e80eeaf49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64b399c3-d3a3-4193-9826-e509b3b9b529", "tag": "b0c5500f-b975-4591-a361-36f0917bc440"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:27:44.212508 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-0accb8d9-0a06-4906-b5f2-cdbd68992254 req-012dd191-66ea-4a2f-9e9a-9b9e80eeaf49 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:44.213199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-0accb8d9-0a06-4906-b5f2-cdbd68992254 req-012dd191-66ea-4a2f-9e9a-9b9e80eeaf49 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:44.214518 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-0accb8d9-0a06-4906-b5f2-cdbd68992254 req-012dd191-66ea-4a2f-9e9a-9b9e80eeaf49 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:44.227608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-0accb8d9-0a06-4906-b5f2-cdbd68992254 req-012dd191-66ea-4a2f-9e9a-9b9e80eeaf49 service nova] Creating event network-changed:b0c5500f-b975-4591-a361-36f0917bc440 for instance 64b399c3-d3a3-4193-9826-e509b3b9b529 on hv-cinder-85199 Aug 26 18:27:44.233553 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-0accb8d9-0a06-4906-b5f2-cdbd68992254 req-012dd191-66ea-4a2f-9e9a-9b9e80eeaf49 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043489 Aug 26 18:27:44.235342 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 292/583] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:27:46.493902 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-332df35f-2cb0-485f-a433-267e259d78b9 req-2f7c40e4-dea5-4966-b31e-b9d86a72f02b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64b399c3-d3a3-4193-9826-e509b3b9b529", "tag": "b0c5500f-b975-4591-a361-36f0917bc440"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:27:46.504754 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-332df35f-2cb0-485f-a433-267e259d78b9 req-2f7c40e4-dea5-4966-b31e-b9d86a72f02b service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:46.505235 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-332df35f-2cb0-485f-a433-267e259d78b9 req-2f7c40e4-dea5-4966-b31e-b9d86a72f02b service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:46.505689 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-332df35f-2cb0-485f-a433-267e259d78b9 req-2f7c40e4-dea5-4966-b31e-b9d86a72f02b service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:46.517775 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-332df35f-2cb0-485f-a433-267e259d78b9 req-2f7c40e4-dea5-4966-b31e-b9d86a72f02b service nova] Creating event network-changed:b0c5500f-b975-4591-a361-36f0917bc440 for instance 64b399c3-d3a3-4193-9826-e509b3b9b529 on hv-cinder-85199 Aug 26 18:27:46.523561 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-332df35f-2cb0-485f-a433-267e259d78b9 req-2f7c40e4-dea5-4966-b31e-b9d86a72f02b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034921 Aug 26 18:27:46.524167 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 292/584] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:27:52.438606 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-92482069-f9de-46fb-a04b-bff464825a7e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:52.439241 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-92482069-f9de-46fb-a04b-bff464825a7e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:52.441555 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:27:52.447496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-92482069-f9de-46fb-a04b-bff464825a7e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:52.448023 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-92482069-f9de-46fb-a04b-bff464825a7e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:52.448528 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-92482069-f9de-46fb-a04b-bff464825a7e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:52.449333 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-92482069-f9de-46fb-a04b-bff464825a7e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:52.449791 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-92482069-f9de-46fb-a04b-bff464825a7e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:52.450214 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-92482069-f9de-46fb-a04b-bff464825a7e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:52.483402 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-92482069-f9de-46fb-a04b-bff464825a7e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/os-volume_attachments/ef166fff-c4e0-448a-ad2e-80f2564678b0" status: 200 len: 194 microversion: 2.20 time: 0.052108 Aug 26 18:27:52.484002 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 293/585] 10.222.0.45 () {60 vars in 1454 bytes} [Fri Aug 26 18:27:52 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/os-volume_attachments/ef166fff-c4e0-448a-ad2e-80f2564678b0 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:27:52.562517 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b0d1b7ec-2fed-45ed-b73e-991739fd59f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:52.563459 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b0d1b7ec-2fed-45ed-b73e-991739fd59f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:52.565645 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=48 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:27:52.571508 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0d1b7ec-2fed-45ed-b73e-991739fd59f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:52.571995 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0d1b7ec-2fed-45ed-b73e-991739fd59f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:52.572424 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0d1b7ec-2fed-45ed-b73e-991739fd59f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:52.573765 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0d1b7ec-2fed-45ed-b73e-991739fd59f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:52.574253 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0d1b7ec-2fed-45ed-b73e-991739fd59f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:52.574910 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0d1b7ec-2fed-45ed-b73e-991739fd59f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:52.614229 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1670096000", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "networks": [{"uuid": "07b555a3-c19d-4c21-bccd-350015a07615"}]}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:27:52.659268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-b0d1b7ec-2fed-45ed-b73e-991739fd59f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lazy-loading 'services' on Instance uuid 1ed32b7d-a792-49b2-84e7-962f4d537501 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:27:52.668815 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.network.neutron [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] validate_networks() for [('07b555a3-c19d-4c21-bccd-350015a07615', None, None, None, None, None)] {{(pid=120540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:27:52.785839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b0d1b7ec-2fed-45ed-b73e-991739fd59f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/os-volume_attachments/ef166fff-c4e0-448a-ad2e-80f2564678b0" status: 202 len: 0 microversion: 2.20 time: 0.227945 Aug 26 18:27:52.786143 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 293/586] 10.222.0.45 () {60 vars in 1457 bytes} [Fri Aug 26 18:27:52 2022] DELETE /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/os-volume_attachments/ef166fff-c4e0-448a-ad2e-80f2564678b0 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:27:52.795325 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1db4bcb8-e3fb-45b7-98e1-3feab9fec2c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:52.797683 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1db4bcb8-e3fb-45b7-98e1-3feab9fec2c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:52.804460 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1db4bcb8-e3fb-45b7-98e1-3feab9fec2c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:52.804978 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1db4bcb8-e3fb-45b7-98e1-3feab9fec2c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:52.805418 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1db4bcb8-e3fb-45b7-98e1-3feab9fec2c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:52.806123 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1db4bcb8-e3fb-45b7-98e1-3feab9fec2c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:52.806653 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1db4bcb8-e3fb-45b7-98e1-3feab9fec2c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:52.807145 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1db4bcb8-e3fb-45b7-98e1-3feab9fec2c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:52.842888 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1db4bcb8-e3fb-45b7-98e1-3feab9fec2c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052125 Aug 26 18:27:52.847755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 294/587] 10.222.0.45 () {60 vars in 1343 bytes} [Fri Aug 26 18:27:52 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 18:27:53.056272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Flavor limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:27:53.056836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Image limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:27:53.057327 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Flavor pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:27:53.057806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Image pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:27:53.058260 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:27:53.070916 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:53.071585 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:53.072163 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:53.073261 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:53.073801 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:53.074494 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:53.093775 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Getting quotas for project e19db2164fb9439c8b079f2baf661b40. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:27:53.098599 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Getting quotas for user 6a8b301eeb0c4cbda40494e57ba78e52 and project e19db2164fb9439c8b079f2baf661b40. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:27:53.111855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Going to run 1 instances... {{(pid=120540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:27:53.114318 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:27:53.165631 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-47615b7d-fa6d-421a-a657-f9228e33dd0b tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555372 Aug 26 18:27:53.166364 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 294/588] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:27:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 18:27:53.177238 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5dce6056-81cb-49e1-b8f9-05a8c70a54b2 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:53.177843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5dce6056-81cb-49e1-b8f9-05a8c70a54b2 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:53.233118 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5dce6056-81cb-49e1-b8f9-05a8c70a54b2 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:53.240765 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5dce6056-81cb-49e1-b8f9-05a8c70a54b2 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1219 microversion: 2.1 time: 0.067088 Aug 26 18:27:53.241457 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 295/589] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:53 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:53.859504 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-817b38b5-1b54-4092-a247-4a8eb74ca606 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:53.862489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-817b38b5-1b54-4092-a247-4a8eb74ca606 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:53.872257 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-817b38b5-1b54-4092-a247-4a8eb74ca606 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:53.872813 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-817b38b5-1b54-4092-a247-4a8eb74ca606 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:53.873247 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-817b38b5-1b54-4092-a247-4a8eb74ca606 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:53.873950 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-817b38b5-1b54-4092-a247-4a8eb74ca606 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:53.874404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-817b38b5-1b54-4092-a247-4a8eb74ca606 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:53.874825 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-817b38b5-1b54-4092-a247-4a8eb74ca606 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:53.908244 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-817b38b5-1b54-4092-a247-4a8eb74ca606 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056312 Aug 26 18:27:53.908856 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 295/590] 10.222.0.45 () {60 vars in 1343 bytes} [Fri Aug 26 18:27:53 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:53.971779 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d0cfce7e-43c5-48e4-8393-318ec8b74931 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:53.972303 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d0cfce7e-43c5-48e4-8393-318ec8b74931 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:53.979478 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0cfce7e-43c5-48e4-8393-318ec8b74931 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:53.979961 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0cfce7e-43c5-48e4-8393-318ec8b74931 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:53.980381 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0cfce7e-43c5-48e4-8393-318ec8b74931 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:53.981110 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0cfce7e-43c5-48e4-8393-318ec8b74931 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:53.981533 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0cfce7e-43c5-48e4-8393-318ec8b74931 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:53.982198 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0cfce7e-43c5-48e4-8393-318ec8b74931 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:54.007914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d0cfce7e-43c5-48e4-8393-318ec8b74931 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:27:54.087280 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d0cfce7e-43c5-48e4-8393-318ec8b74931 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 204 len: 0 microversion: 2.20 time: 0.119052 Aug 26 18:27:54.088144 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 296/591] 10.222.0.45 () {60 vars in 1280 bytes} [Fri Aug 26 18:27:53 2022] DELETE /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 18:27:54.097206 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8ca330a4-ee22-4d19-8a87-8271e4b13205 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:54.097816 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8ca330a4-ee22-4d19-8a87-8271e4b13205 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:54.103774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8ca330a4-ee22-4d19-8a87-8271e4b13205 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:54.104248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8ca330a4-ee22-4d19-8a87-8271e4b13205 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:54.104671 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8ca330a4-ee22-4d19-8a87-8271e4b13205 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:54.105395 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8ca330a4-ee22-4d19-8a87-8271e4b13205 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:54.105838 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8ca330a4-ee22-4d19-8a87-8271e4b13205 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:54.106245 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8ca330a4-ee22-4d19-8a87-8271e4b13205 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:54.235616 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8ca330a4-ee22-4d19-8a87-8271e4b13205 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:54.243988 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8ca330a4-ee22-4d19-8a87-8271e4b13205 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:54.245504 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8ca330a4-ee22-4d19-8a87-8271e4b13205 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:54.246680 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8ca330a4-ee22-4d19-8a87-8271e4b13205 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.154196 Aug 26 18:27:54.247206 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 296/592] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:27:54 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:27:54.263705 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8a1f5e23-c002-48ff-9ded-0af6eb8be554 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:54.264761 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8a1f5e23-c002-48ff-9ded-0af6eb8be554 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:54.271877 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a1f5e23-c002-48ff-9ded-0af6eb8be554 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:54.272362 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a1f5e23-c002-48ff-9ded-0af6eb8be554 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:54.273133 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a1f5e23-c002-48ff-9ded-0af6eb8be554 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:54.273911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a1f5e23-c002-48ff-9ded-0af6eb8be554 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:54.274397 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a1f5e23-c002-48ff-9ded-0af6eb8be554 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:54.274812 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a1f5e23-c002-48ff-9ded-0af6eb8be554 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:54.343508 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8a1f5e23-c002-48ff-9ded-0af6eb8be554 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:54.351863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8a1f5e23-c002-48ff-9ded-0af6eb8be554 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1271 microversion: 2.1 time: 0.093436 Aug 26 18:27:54.352461 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 297/593] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:54 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:55.273616 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f71f6696-53e3-4c77-aab6-98419a1b0fb7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:55.274427 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f71f6696-53e3-4c77-aab6-98419a1b0fb7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:55.283430 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f71f6696-53e3-4c77-aab6-98419a1b0fb7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:55.283943 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f71f6696-53e3-4c77-aab6-98419a1b0fb7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:55.284440 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f71f6696-53e3-4c77-aab6-98419a1b0fb7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:55.285174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f71f6696-53e3-4c77-aab6-98419a1b0fb7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:55.285612 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f71f6696-53e3-4c77-aab6-98419a1b0fb7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:55.286139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f71f6696-53e3-4c77-aab6-98419a1b0fb7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:55.373980 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b87726bb-f698-4e99-b296-ad1b7fa068dc tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:55.374922 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b87726bb-f698-4e99-b296-ad1b7fa068dc tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:55.382492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b87726bb-f698-4e99-b296-ad1b7fa068dc tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:55.382971 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b87726bb-f698-4e99-b296-ad1b7fa068dc tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:55.383445 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b87726bb-f698-4e99-b296-ad1b7fa068dc tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:55.384345 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b87726bb-f698-4e99-b296-ad1b7fa068dc tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:55.384864 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b87726bb-f698-4e99-b296-ad1b7fa068dc tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:55.385313 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b87726bb-f698-4e99-b296-ad1b7fa068dc tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:55.426230 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f71f6696-53e3-4c77-aab6-98419a1b0fb7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:55.435395 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f71f6696-53e3-4c77-aab6-98419a1b0fb7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:55.436985 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f71f6696-53e3-4c77-aab6-98419a1b0fb7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:55.438268 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f71f6696-53e3-4c77-aab6-98419a1b0fb7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.171403 Aug 26 18:27:55.438909 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 297/594] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:27:55 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:27:55.455147 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b87726bb-f698-4e99-b296-ad1b7fa068dc tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:55.463176 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b87726bb-f698-4e99-b296-ad1b7fa068dc tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1271 microversion: 2.1 time: 0.093920 Aug 26 18:27:55.463752 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 298/595] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:55 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:56.463116 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-5f9ca41f-8f08-452f-a871-2a16a0e88af4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:56.466812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-5f9ca41f-8f08-452f-a871-2a16a0e88af4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:56.476891 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5f9ca41f-8f08-452f-a871-2a16a0e88af4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:56.477739 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5f9ca41f-8f08-452f-a871-2a16a0e88af4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:56.479927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5f9ca41f-8f08-452f-a871-2a16a0e88af4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:56.480994 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5f9ca41f-8f08-452f-a871-2a16a0e88af4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:56.481660 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5f9ca41f-8f08-452f-a871-2a16a0e88af4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:56.482304 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5f9ca41f-8f08-452f-a871-2a16a0e88af4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:56.485866 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9de152bb-6a69-462e-b368-a47a43796ca8 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:56.486543 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9de152bb-6a69-462e-b368-a47a43796ca8 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:56.498693 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9de152bb-6a69-462e-b368-a47a43796ca8 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:56.499479 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9de152bb-6a69-462e-b368-a47a43796ca8 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:56.501253 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9de152bb-6a69-462e-b368-a47a43796ca8 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:56.502626 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9de152bb-6a69-462e-b368-a47a43796ca8 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:56.503768 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9de152bb-6a69-462e-b368-a47a43796ca8 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:56.504659 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9de152bb-6a69-462e-b368-a47a43796ca8 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:56.621985 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9de152bb-6a69-462e-b368-a47a43796ca8 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:56.630942 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9de152bb-6a69-462e-b368-a47a43796ca8 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1277 microversion: 2.1 time: 0.150549 Aug 26 18:27:56.631517 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 299/596] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:56 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:56.692156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5f9ca41f-8f08-452f-a871-2a16a0e88af4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:56.701439 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5f9ca41f-8f08-452f-a871-2a16a0e88af4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:56.703070 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5f9ca41f-8f08-452f-a871-2a16a0e88af4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:56.705636 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-5f9ca41f-8f08-452f-a871-2a16a0e88af4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1724 microversion: 2.20 time: 0.246519 Aug 26 18:27:56.706293 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 298/597] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:27:56 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:27:57.035363 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-45fe32fc-65f0-403e-9698-062a2dbb838e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:57.035862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-45fe32fc-65f0-403e-9698-062a2dbb838e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:57.042240 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45fe32fc-65f0-403e-9698-062a2dbb838e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:57.042720 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45fe32fc-65f0-403e-9698-062a2dbb838e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:57.043146 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45fe32fc-65f0-403e-9698-062a2dbb838e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:57.044122 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45fe32fc-65f0-403e-9698-062a2dbb838e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:57.044594 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45fe32fc-65f0-403e-9698-062a2dbb838e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:57.045047 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45fe32fc-65f0-403e-9698-062a2dbb838e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:57.086161 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-45fe32fc-65f0-403e-9698-062a2dbb838e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667/ips" status: 200 len: 151 microversion: 2.1 time: 0.054685 Aug 26 18:27:57.086729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 300/598] 10.222.0.45 () {58 vars in 1248 bytes} [Fri Aug 26 18:27:57 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667/ips => generated 151 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:27:57.100036 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7e9b9e8a-a0ea-4fda-8655-fc424614fa8d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3821b2b8-6081-41b9-a7df-6a6eccaeb4a5"}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:27:57.108963 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-7e9b9e8a-a0ea-4fda-8655-fc424614fa8d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:57.117082 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7e9b9e8a-a0ea-4fda-8655-fc424614fa8d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:57.117564 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7e9b9e8a-a0ea-4fda-8655-fc424614fa8d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:57.117990 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7e9b9e8a-a0ea-4fda-8655-fc424614fa8d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:57.119412 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7e9b9e8a-a0ea-4fda-8655-fc424614fa8d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:57.119872 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7e9b9e8a-a0ea-4fda-8655-fc424614fa8d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:57.120291 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7e9b9e8a-a0ea-4fda-8655-fc424614fa8d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:57.182391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-a9ea8380-3183-4b17-adf3-391a3a7fc10f req-b7985f61-6566-4975-86a0-09308f345fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed32b7d-a792-49b2-84e7-962f4d537501", "name": "network-vif-deleted", "tag": "ae3cb7b6-5071-4281-b758-acbb49eab67f"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:27:57.211719 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-a9ea8380-3183-4b17-adf3-391a3a7fc10f req-b7985f61-6566-4975-86a0-09308f345fc6 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:57.213054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-a9ea8380-3183-4b17-adf3-391a3a7fc10f req-b7985f61-6566-4975-86a0-09308f345fc6 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:57.215094 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-a9ea8380-3183-4b17-adf3-391a3a7fc10f req-b7985f61-6566-4975-86a0-09308f345fc6 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:57.248707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-a9ea8380-3183-4b17-adf3-391a3a7fc10f req-b7985f61-6566-4975-86a0-09308f345fc6 service nova] Creating event network-vif-deleted:ae3cb7b6-5071-4281-b758-acbb49eab67f for instance 1ed32b7d-a792-49b2-84e7-962f4d537501 on hv-cinder-85199 Aug 26 18:27:57.255850 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-a9ea8380-3183-4b17-adf3-391a3a7fc10f req-b7985f61-6566-4975-86a0-09308f345fc6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081217 Aug 26 18:27:57.257106 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 301/599] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:27:57.280090 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-7e9b9e8a-a0ea-4fda-8655-fc424614fa8d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] HTTP exception thrown: Invalid volume: volume 3821b2b8-6081-41b9-a7df-6a6eccaeb4a5 is already attached to instances: eb0359a4-7ac3-470c-8fe7-31ed2faab28b Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7e9b9e8a-a0ea-4fda-8655-fc424614fa8d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Request method failure captured: Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: POST /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667/os-volume_attachments HTTP/1.1 Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 74 Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ_7WV4eHbAqOpnTYkwFP6-jB3HCDjeZbl0R247dr5RR1y2TCZ3q7yJc3wAkX4naY95SpgiF97bav2cRanoMnEaxUU8VKQlnKSHzILsN-blIL91h5HmfvqVCwXlIyEUHdZjNlc9SaFqhXfX303L2e3MPsBKCAHoO-gSYEI6n3TQjqMw Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:27:57.285139 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:27:57.286646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_67f4fd75428040ab9ff8a0458e4708fb", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/67f4fd75428040ab9ff8a0458e4708fb"}]}] Aug 26 18:27:57.286646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:27:57.286646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:27:57.286646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:27:57.286646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:27:57.286646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:27:57.286646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:27:57.286646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: a1be02f9e7fd4bdabc05ec48e2a35f56 Aug 26 18:27:57.286646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:27:57.286646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Aug 26 18:27:57.286646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {"volumeAttachment": {"volumeId": "3821b2b8-6081-41b9-a7df-6a6eccaeb4a5"}} Aug 26 18:27:57.286646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Invalid volume: volume 3821b2b8-6081-41b9-a7df-6a6eccaeb4a5 is already attached to instances: eb0359a4-7ac3-470c-8fe7-31ed2faab28b Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'server_id': 'b1da52f0-5bd3-4c2e-b4e5-87627616f667', 'body': {'volumeAttachment': {'volumeId': '3821b2b8-6081-41b9-a7df-6a6eccaeb4a5'}}} Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3821b2b8-6081-41b9-a7df-6a6eccaeb4a5 is already attached to instances: eb0359a4-7ac3-470c-8fe7-31ed2faab28b Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:27:57.287410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3821b2b8-6081-41b9-a7df-6a6eccaeb4a5 is already attached to instances: eb0359a4-7ac3-470c-8fe7-31ed2faab28b Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:27:57.288602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:27:57.291768 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:27:57.291768 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:27:57.291768 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:27:57.291768 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3821b2b8-6081-41b9-a7df-6a6eccaeb4a5 is already attached to instances: eb0359a4-7ac3-470c-8fe7-31ed2faab28b Aug 26 18:27:57.291768 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:27:57.291768 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7e9b9e8a-a0ea-4fda-8655-fc424614fa8d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Returning 400 to user: Invalid volume: volume 3821b2b8-6081-41b9-a7df-6a6eccaeb4a5 is already attached to instances: eb0359a4-7ac3-470c-8fe7-31ed2faab28b {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:27:57.291768 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-7e9b9e8a-a0ea-4fda-8655-fc424614fa8d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "POST /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.194018 Aug 26 18:27:57.291768 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 299/600] 10.222.0.45 () {60 vars in 1323 bytes} [Fri Aug 26 18:27:57 2022] POST /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667/os-volume_attachments => generated 174 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 18:27:57.305928 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-80fcf89b-d016-41b2-bc87-aff4c8eca51c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:57.307177 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-80fcf89b-d016-41b2-bc87-aff4c8eca51c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:57.327304 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80fcf89b-d016-41b2-bc87-aff4c8eca51c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:57.327699 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80fcf89b-d016-41b2-bc87-aff4c8eca51c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:57.328139 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80fcf89b-d016-41b2-bc87-aff4c8eca51c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:57.329239 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80fcf89b-d016-41b2-bc87-aff4c8eca51c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:57.329697 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80fcf89b-d016-41b2-bc87-aff4c8eca51c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:57.330122 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80fcf89b-d016-41b2-bc87-aff4c8eca51c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:57.367778 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-80fcf89b-d016-41b2-bc87-aff4c8eca51c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:27:57.371640 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:27:57.509908 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-80fcf89b-d016-41b2-bc87-aff4c8eca51c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 204 len: 0 microversion: 2.1 time: 0.213976 Aug 26 18:27:57.510641 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 302/601] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:27:57 2022] DELETE /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:27:57.519341 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d55039e9-19b5-4cac-8e28-c41477d3521b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:57.520232 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-d55039e9-19b5-4cac-8e28-c41477d3521b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:57.533643 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d55039e9-19b5-4cac-8e28-c41477d3521b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:57.534760 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d55039e9-19b5-4cac-8e28-c41477d3521b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:57.536346 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d55039e9-19b5-4cac-8e28-c41477d3521b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:57.538994 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d55039e9-19b5-4cac-8e28-c41477d3521b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:57.542053 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d55039e9-19b5-4cac-8e28-c41477d3521b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:57.543113 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d55039e9-19b5-4cac-8e28-c41477d3521b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:57.652375 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a642a988-b78a-4217-9537-7a79597b1455 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:57.653106 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a642a988-b78a-4217-9537-7a79597b1455 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:57.660068 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a642a988-b78a-4217-9537-7a79597b1455 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:57.660564 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a642a988-b78a-4217-9537-7a79597b1455 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:57.661268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a642a988-b78a-4217-9537-7a79597b1455 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:57.661761 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a642a988-b78a-4217-9537-7a79597b1455 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:57.662213 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a642a988-b78a-4217-9537-7a79597b1455 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:57.662637 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a642a988-b78a-4217-9537-7a79597b1455 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:57.762154 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d55039e9-19b5-4cac-8e28-c41477d3521b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:57.774578 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-d55039e9-19b5-4cac-8e28-c41477d3521b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1681 microversion: 2.1 time: 0.259139 Aug 26 18:27:57.776470 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 300/602] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:57 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1681 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:57.797144 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:57.798104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:57.799346 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a642a988-b78a-4217-9537-7a79597b1455 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:57.806014 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:57.806733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:57.807431 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a642a988-b78a-4217-9537-7a79597b1455 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1319 microversion: 2.1 time: 0.159615 Aug 26 18:27:57.807602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:57.808628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:57.809277 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:57.809916 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:57.820939 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 303/603] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:57 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:27:57.846375 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:57.846958 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:57.847383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:57.847997 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lazy-loading 'fault' on Instance uuid 1ed32b7d-a792-49b2-84e7-962f4d537501 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:27:57.890248 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-1a1acc86-432e-4455-9251-9baa9f56bdea req-221684d8-cd31-4c27-b5fe-995ec02ff63e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0208ae-2692-4fda-adb6-946c6cec83ae", "tag": "7f27addd-0afe-46bb-b1ec-6d8f2557e27c"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:27:57.900217 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1a1acc86-432e-4455-9251-9baa9f56bdea req-221684d8-cd31-4c27-b5fe-995ec02ff63e service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:57.900693 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1a1acc86-432e-4455-9251-9baa9f56bdea req-221684d8-cd31-4c27-b5fe-995ec02ff63e service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:57.901681 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1a1acc86-432e-4455-9251-9baa9f56bdea req-221684d8-cd31-4c27-b5fe-995ec02ff63e service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:57.912630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-1a1acc86-432e-4455-9251-9baa9f56bdea req-221684d8-cd31-4c27-b5fe-995ec02ff63e service nova] Creating event network-changed:7f27addd-0afe-46bb-b1ec-6d8f2557e27c for instance 5b0208ae-2692-4fda-adb6-946c6cec83ae on hv-cinder-85199 Aug 26 18:27:57.918642 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-1a1acc86-432e-4455-9251-9baa9f56bdea req-221684d8-cd31-4c27-b5fe-995ec02ff63e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032633 Aug 26 18:27:57.919647 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 304/604] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:27:57.923370 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:57.933157 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:57.934833 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:57.936141 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-fa7e5dd8-b81f-45f6-8db2-e3d56e27e8f7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1372 microversion: 2.20 time: 0.143179 Aug 26 18:27:57.952760 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 301/605] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:27:57 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1372 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:27:58.800141 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e160d66e-ec14-45ac-ae1a-8310e944fc0f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:58.801003 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e160d66e-ec14-45ac-ae1a-8310e944fc0f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:58.808833 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e160d66e-ec14-45ac-ae1a-8310e944fc0f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:58.809348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e160d66e-ec14-45ac-ae1a-8310e944fc0f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:58.809764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e160d66e-ec14-45ac-ae1a-8310e944fc0f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:58.810727 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e160d66e-ec14-45ac-ae1a-8310e944fc0f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:58.811179 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e160d66e-ec14-45ac-ae1a-8310e944fc0f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:58.811598 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e160d66e-ec14-45ac-ae1a-8310e944fc0f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:58.828254 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-5e41fe3f-b938-4943-a05f-e25ad28637a4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:58.829662 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-5e41fe3f-b938-4943-a05f-e25ad28637a4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:58.838610 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5e41fe3f-b938-4943-a05f-e25ad28637a4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:58.839663 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5e41fe3f-b938-4943-a05f-e25ad28637a4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:58.840149 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5e41fe3f-b938-4943-a05f-e25ad28637a4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:58.840994 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5e41fe3f-b938-4943-a05f-e25ad28637a4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:58.841418 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5e41fe3f-b938-4943-a05f-e25ad28637a4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:58.842693 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5e41fe3f-b938-4943-a05f-e25ad28637a4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:58.971530 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e160d66e-ec14-45ac-ae1a-8310e944fc0f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:58.980481 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e160d66e-ec14-45ac-ae1a-8310e944fc0f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1681 microversion: 2.1 time: 0.185788 Aug 26 18:27:58.981083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 305/606] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:58 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:58.987664 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:27:58.989078 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:27:58.997375 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:58.997878 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:58.998309 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:58.999010 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:58.999456 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:58.999867 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:59.038758 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:27:59.039230 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:27:59.039652 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:27:59.040094 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lazy-loading 'fault' on Instance uuid 1ed32b7d-a792-49b2-84e7-962f4d537501 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:27:59.050179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5e41fe3f-b938-4943-a05f-e25ad28637a4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:59.065034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-5e41fe3f-b938-4943-a05f-e25ad28637a4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1319 microversion: 2.1 time: 0.237420 Aug 26 18:27:59.077358 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 302/607] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:58 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:27:59.083935 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:59.098626 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:59.100460 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:27:59.101679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4cb34923-6798-4d57-adc7-cf1045b00c31 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 200 len: 1372 microversion: 2.20 time: 0.118409 Aug 26 18:27:59.102620 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 306/608] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:27:58 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 1372 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:00.002565 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-a810e97a-8930-488e-b6a9-ec235d3ca1fd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:00.003137 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-a810e97a-8930-488e-b6a9-ec235d3ca1fd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:00.010193 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a810e97a-8930-488e-b6a9-ec235d3ca1fd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:00.010677 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a810e97a-8930-488e-b6a9-ec235d3ca1fd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:00.011116 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a810e97a-8930-488e-b6a9-ec235d3ca1fd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:00.011831 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a810e97a-8930-488e-b6a9-ec235d3ca1fd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:00.012556 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a810e97a-8930-488e-b6a9-ec235d3ca1fd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:00.013260 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a810e97a-8930-488e-b6a9-ec235d3ca1fd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:00.077863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a810e97a-8930-488e-b6a9-ec235d3ca1fd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:00.086355 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cf56d57d-c476-44a2-88b3-bdf2f0ac7c48 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:00.086891 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-a810e97a-8930-488e-b6a9-ec235d3ca1fd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1614 microversion: 2.1 time: 0.087780 Aug 26 18:28:00.087459 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 303/609] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:27:59 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1614 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:00.088007 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cf56d57d-c476-44a2-88b3-bdf2f0ac7c48 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:00.101035 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf56d57d-c476-44a2-88b3-bdf2f0ac7c48 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:00.101556 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf56d57d-c476-44a2-88b3-bdf2f0ac7c48 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:00.101998 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf56d57d-c476-44a2-88b3-bdf2f0ac7c48 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:00.102707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf56d57d-c476-44a2-88b3-bdf2f0ac7c48 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:00.103155 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf56d57d-c476-44a2-88b3-bdf2f0ac7c48 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:00.103574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf56d57d-c476-44a2-88b3-bdf2f0ac7c48 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:00.126404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-cb77b832-6bf5-4100-9cd4-858c2d332c75 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:00.127018 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-cb77b832-6bf5-4100-9cd4-858c2d332c75 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:00.133191 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cb77b832-6bf5-4100-9cd4-858c2d332c75 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:00.133607 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cb77b832-6bf5-4100-9cd4-858c2d332c75 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:00.134033 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cb77b832-6bf5-4100-9cd4-858c2d332c75 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:00.134950 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cb77b832-6bf5-4100-9cd4-858c2d332c75 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:00.135400 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cb77b832-6bf5-4100-9cd4-858c2d332c75 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:00.135822 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cb77b832-6bf5-4100-9cd4-858c2d332c75 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:00.150668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-cb77b832-6bf5-4100-9cd4-858c2d332c75 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] HTTP exception thrown: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-cb77b832-6bf5-4100-9cd4-858c2d332c75 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Request method failure captured: Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 HTTP/1.1 Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ-u8QOp5__8Yf7VkiKP3aGHvCdLBtDCcGlQC4PkhvU7w7Z_ut2VIjOIG6S8SGCK_QTLQXA-x4UgbDlTS8WaCG1SP-tnDR83EIrrD19Wkhngn5K58B7BD5uPSV1hrpZ9obmVH_ciV8K-xDUUFINTcE6IlnUqBf65YrnQPNolZgptxO4 Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 4e1167fc380043c5b04a6746d715003a Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:28:00.152670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:28:00.154174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4e1167fc380043c5b04a6746d715003a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4e1167fc380043c5b04a6746d715003a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4e1167fc380043c5b04a6746d715003a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4e1167fc380043c5b04a6746d715003a"}]}] Aug 26 18:28:00.154174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:28:00.154174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 4e1167fc380043c5b04a6746d715003a Aug 26 18:28:00.154174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:28:00.154174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-AttachVolumeShelveTestJSON-72087033-project Aug 26 18:28:00.154174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:28:00.154174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:28:00.154174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: cde02839effc4354a4fd7e82c1dc8e26 Aug 26 18:28:00.154174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72087033-project Aug 26 18:28:00.154174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:28:00.154174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. Aug 26 18:28:00.154174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '1ed32b7d-a792-49b2-84e7-962f4d537501'} Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:28:00.155688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. Aug 26 18:28:00.157701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:00.159236 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-cb77b832-6bf5-4100-9cd4-858c2d332c75 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Returning 404 to user: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:28:00.167629 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-cb77b832-6bf5-4100-9cd4-858c2d332c75 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 404 len: 111 microversion: 2.20 time: 0.032415 Aug 26 18:28:00.168993 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 304/610] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:00 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 26 18:28:00.176851 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-94bcfa90-f121-4ac1-8bac-89d9dc7bb8b3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '.version_select at 0x7fc744550ca0>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:00.181655 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR oslo.messaging._drivers.impl_rabbit [None req-94bcfa90-f121-4ac1-8bac-89d9dc7bb8b3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [bc631ef2-21d2-49d7-a575-956d5a36eb45] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 26 18:28:00.287393 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cf56d57d-c476-44a2-88b3-bdf2f0ac7c48 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:00.295753 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cf56d57d-c476-44a2-88b3-bdf2f0ac7c48 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1319 microversion: 2.1 time: 0.213090 Aug 26 18:28:00.303266 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 307/611] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:00 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:28:00.303266 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-b62d1a9b-b748-4bc8-accf-8acc8666adfb req-ab296022-0f28-4731-8eb9-7bedbb6ad944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1da52f0-5bd3-4c2e-b4e5-87627616f667", "name": "network-vif-deleted", "tag": "e6c0fcc7-e805-4ce2-93c2-b4c7a7fb0f4a"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:00.311665 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b62d1a9b-b748-4bc8-accf-8acc8666adfb req-ab296022-0f28-4731-8eb9-7bedbb6ad944 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:00.312144 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b62d1a9b-b748-4bc8-accf-8acc8666adfb req-ab296022-0f28-4731-8eb9-7bedbb6ad944 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:00.312571 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b62d1a9b-b748-4bc8-accf-8acc8666adfb req-ab296022-0f28-4731-8eb9-7bedbb6ad944 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:00.324892 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-b62d1a9b-b748-4bc8-accf-8acc8666adfb req-ab296022-0f28-4731-8eb9-7bedbb6ad944 service nova] Creating event network-vif-deleted:e6c0fcc7-e805-4ce2-93c2-b4c7a7fb0f4a for instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 on hv-cinder-85199 Aug 26 18:28:00.330301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-b62d1a9b-b748-4bc8-accf-8acc8666adfb req-ab296022-0f28-4731-8eb9-7bedbb6ad944 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032219 Aug 26 18:28:00.330921 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 308/612] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:01.108522 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0c191bb5-6f7e-4008-949f-296b70c85d2d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:01.109420 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0c191bb5-6f7e-4008-949f-296b70c85d2d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:01.118609 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c191bb5-6f7e-4008-949f-296b70c85d2d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:01.119372 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c191bb5-6f7e-4008-949f-296b70c85d2d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:01.119944 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c191bb5-6f7e-4008-949f-296b70c85d2d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:01.120820 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c191bb5-6f7e-4008-949f-296b70c85d2d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:01.121396 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c191bb5-6f7e-4008-949f-296b70c85d2d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:01.122025 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c191bb5-6f7e-4008-949f-296b70c85d2d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:01.162797 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c191bb5-6f7e-4008-949f-296b70c85d2d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:01.163085 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c191bb5-6f7e-4008-949f-296b70c85d2d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:01.164216 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c191bb5-6f7e-4008-949f-296b70c85d2d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:01.164760 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-0c191bb5-6f7e-4008-949f-296b70c85d2d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lazy-loading 'fault' on Instance uuid b1da52f0-5bd3-4c2e-b4e5-87627616f667 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:28:01.189855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO oslo.messaging._drivers.impl_rabbit [None req-94bcfa90-f121-4ac1-8bac-89d9dc7bb8b3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [bc631ef2-21d2-49d7-a575-956d5a36eb45] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 38492. Aug 26 18:28:01.216252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-94bcfa90-f121-4ac1-8bac-89d9dc7bb8b3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199745493" status: 204 len: 0 microversion: 2.20 time: 1.043100 Aug 26 18:28:01.217811 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 305/613] 10.222.0.45 () {60 vars in 1262 bytes} [Fri Aug 26 18:28:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199745493 => generated 0 bytes in 1045 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 18:28:01.224498 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0c191bb5-6f7e-4008-949f-296b70c85d2d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:01.233030 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0c191bb5-6f7e-4008-949f-296b70c85d2d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 200 len: 1330 microversion: 2.1 time: 0.129209 Aug 26 18:28:01.233623 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 309/614] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:01 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 1330 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:01.317369 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f0911e95-94a2-4163-864b-6b835e5285f4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:01.317985 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f0911e95-94a2-4163-864b-6b835e5285f4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:01.326107 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f0911e95-94a2-4163-864b-6b835e5285f4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:01.326889 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f0911e95-94a2-4163-864b-6b835e5285f4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:01.327329 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f0911e95-94a2-4163-864b-6b835e5285f4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:01.328068 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f0911e95-94a2-4163-864b-6b835e5285f4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:01.328760 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f0911e95-94a2-4163-864b-6b835e5285f4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:01.329175 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f0911e95-94a2-4163-864b-6b835e5285f4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:01.507274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f0911e95-94a2-4163-864b-6b835e5285f4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:01.517871 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f0911e95-94a2-4163-864b-6b835e5285f4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1319 microversion: 2.1 time: 0.204554 Aug 26 18:28:01.518902 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 306/615] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:01 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:01.922907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d46809c-8a71-4779-9cf6-501ba6565254 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Action: 'create', calling method: .version_select at 0x7fc74410e040>, body: {"keypair": {"name": "tempest-keypair-639047670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4hjwGzGOwJ7VF5db23sHxmfSHuNDQuPJUvknGi9Pk90ECRrW6aPzJe+8J/UhJjioJDsIfFl/QYr/oL8OqRkBYQc4jQAuWGH/M4gusEMwEnCI0gcT4L+TKDbFTaUtz9KQ=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:01.939359 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-7d46809c-8a71-4779-9cf6-501ba6565254 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Getting quotas for project 4e1167fc380043c5b04a6746d715003a. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:28:01.943464 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-7d46809c-8a71-4779-9cf6-501ba6565254 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Getting quotas for user cde02839effc4354a4fd7e82c1dc8e26 and project 4e1167fc380043c5b04a6746d715003a. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:28:01.967276 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7d46809c-8a71-4779-9cf6-501ba6565254 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048485 Aug 26 18:28:01.967902 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 310/616] 10.222.0.45 () {62 vars in 1200 bytes} [Fri Aug 26 18:28:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 26 18:28:02.255244 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-334fc970-25df-495d-9eab-2451d6d4fbad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:02.255886 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-334fc970-25df-495d-9eab-2451d6d4fbad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:02.263069 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-334fc970-25df-495d-9eab-2451d6d4fbad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:02.263565 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-334fc970-25df-495d-9eab-2451d6d4fbad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:02.264008 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-334fc970-25df-495d-9eab-2451d6d4fbad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:02.264710 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-334fc970-25df-495d-9eab-2451d6d4fbad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:02.265263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-334fc970-25df-495d-9eab-2451d6d4fbad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:02.265683 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-334fc970-25df-495d-9eab-2451d6d4fbad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:02.280536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-334fc970-25df-495d-9eab-2451d6d4fbad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] HTTP exception thrown: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-334fc970-25df-495d-9eab-2451d6d4fbad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Request method failure captured: Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 HTTP/1.1 Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ_7WV4eHbAqOpnTYkwFP6-jB3HCDjeZbl0R247dr5RR1y2TCZ3q7yJc3wAkX4naY95SpgiF97bav2cRanoMnEaxUU8VKQlnKSHzILsN-blIL91h5HmfvqVCwXlIyEUHdZjNlc9SaFqhXfX303L2e3MPsBKCAHoO-gSYEI6n3TQjqMw Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:28:02.282104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:28:02.283633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_67f4fd75428040ab9ff8a0458e4708fb", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/67f4fd75428040ab9ff8a0458e4708fb"}]}] Aug 26 18:28:02.283633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:28:02.283633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:28:02.283633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:28:02.283633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:28:02.283633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:28:02.283633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:28:02.283633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: a1be02f9e7fd4bdabc05ec48e2a35f56 Aug 26 18:28:02.283633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:28:02.283633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:28:02.283633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. Aug 26 18:28:02.283633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': 'b1da52f0-5bd3-4c2e-b4e5-87627616f667'} Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:28:02.284484 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. Aug 26 18:28:02.285973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:02.287272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-334fc970-25df-495d-9eab-2451d6d4fbad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Returning 404 to user: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:28:02.287272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-334fc970-25df-495d-9eab-2451d6d4fbad tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 404 len: 111 microversion: 2.1 time: 0.032463 Aug 26 18:28:02.287272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 307/617] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:02 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:28:02.293208 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3827f1a5-013d-46f0-94bc-78189cf1fd5a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '.version_select at 0x7fc7442090d0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:02.315484 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3827f1a5-013d-46f0-94bc-78189cf1fd5a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-112475887" status: 202 len: 0 microversion: 2.1 time: 0.026671 Aug 26 18:28:02.316097 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 311/618] 10.222.0.45 () {58 vars in 1218 bytes} [Fri Aug 26 18:28:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-112475887 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:28:02.542039 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-dc86f091-b929-4f09-a580-2b382b9ae9bd tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:02.543236 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-dc86f091-b929-4f09-a580-2b382b9ae9bd tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:02.551688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc86f091-b929-4f09-a580-2b382b9ae9bd tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:02.552235 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc86f091-b929-4f09-a580-2b382b9ae9bd tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:02.552664 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc86f091-b929-4f09-a580-2b382b9ae9bd tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:02.553468 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc86f091-b929-4f09-a580-2b382b9ae9bd tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:02.554103 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc86f091-b929-4f09-a580-2b382b9ae9bd tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:02.554706 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc86f091-b929-4f09-a580-2b382b9ae9bd tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:02.763924 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-dc86f091-b929-4f09-a580-2b382b9ae9bd tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:02.772334 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-dc86f091-b929-4f09-a580-2b382b9ae9bd tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1319 microversion: 2.1 time: 0.234501 Aug 26 18:28:02.772964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 308/619] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:02 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:03.041378 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-99b13204-541f-47e3-a62d-dcf6d8934f1e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:03.041869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-99b13204-541f-47e3-a62d-dcf6d8934f1e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:03.049921 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99b13204-541f-47e3-a62d-dcf6d8934f1e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:03.050495 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99b13204-541f-47e3-a62d-dcf6d8934f1e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:03.050977 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99b13204-541f-47e3-a62d-dcf6d8934f1e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:03.051870 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99b13204-541f-47e3-a62d-dcf6d8934f1e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:03.052465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99b13204-541f-47e3-a62d-dcf6d8934f1e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:03.052928 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99b13204-541f-47e3-a62d-dcf6d8934f1e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:03.144840 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-99b13204-541f-47e3-a62d-dcf6d8934f1e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lazy-loading 'services' on Instance uuid eb0359a4-7ac3-470c-8fe7-31ed2faab28b {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:28:03.220557 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-99b13204-541f-47e3-a62d-dcf6d8934f1e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b/os-volume_attachments/3821b2b8-6081-41b9-a7df-6a6eccaeb4a5" status: 202 len: 0 microversion: 2.1 time: 0.183515 Aug 26 18:28:03.221400 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 312/620] 10.222.0.45 () {58 vars in 1416 bytes} [Fri Aug 26 18:28:03 2022] DELETE /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b/os-volume_attachments/3821b2b8-6081-41b9-a7df-6a6eccaeb4a5 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:28:03.230383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-a12f9d96-8597-404b-ba43-6c8011144c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:03.232628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-a12f9d96-8597-404b-ba43-6c8011144c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:03.237867 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:03.238606 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=6 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:03.241013 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a12f9d96-8597-404b-ba43-6c8011144c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:03.241895 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a12f9d96-8597-404b-ba43-6c8011144c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:03.242585 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a12f9d96-8597-404b-ba43-6c8011144c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:03.243427 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a12f9d96-8597-404b-ba43-6c8011144c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:03.243911 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a12f9d96-8597-404b-ba43-6c8011144c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:03.244329 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a12f9d96-8597-404b-ba43-6c8011144c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:03.250697 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=100 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:03.280054 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-a12f9d96-8597-404b-ba43-6c8011144c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053688 Aug 26 18:28:03.281282 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 309/621] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:28:03 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:28:03.441995 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1457713915", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f8ca64c-3b3d-4193-a2ad-338b8fd1327b"}], "security_groups": [{"name": "tempest-securitygroup--1513244449"}], "key_name": "tempest-keypair-639047670", "user_data": "}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:03.558639 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] validate_networks() for [('5f8ca64c-3b3d-4193-a2ad-338b8fd1327b', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:28:03.794360 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2f67666a-9eae-440f-af12-69b5c5d4fe2c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:03.795852 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2f67666a-9eae-440f-af12-69b5c5d4fe2c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:03.803058 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2f67666a-9eae-440f-af12-69b5c5d4fe2c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:03.803517 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2f67666a-9eae-440f-af12-69b5c5d4fe2c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:03.804121 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2f67666a-9eae-440f-af12-69b5c5d4fe2c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:03.805103 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2f67666a-9eae-440f-af12-69b5c5d4fe2c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:03.805280 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2f67666a-9eae-440f-af12-69b5c5d4fe2c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:03.805718 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2f67666a-9eae-440f-af12-69b5c5d4fe2c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:03.965269 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:28:03.965681 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:28:03.967149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:28:03.967149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:28:03.967388 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:28:03.976931 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:03.977407 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:03.977837 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:03.978568 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:03.979013 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:03.979593 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:04.001131 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Getting quotas for project 4e1167fc380043c5b04a6746d715003a. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:28:04.005983 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Getting quotas for user cde02839effc4354a4fd7e82c1dc8e26 and project 4e1167fc380043c5b04a6746d715003a. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:28:04.022687 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:28:04.025897 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:28:04.092844 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ee96015d-b3ab-4468-9bbf-833454567ea7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.655290 Aug 26 18:28:04.094286 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 313/622] 10.222.0.45 () {62 vars in 1188 bytes} [Fri Aug 26 18:28:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 26 18:28:04.105932 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-62883783-4073-4fd1-b5db-d81c9850959f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:04.106565 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-62883783-4073-4fd1-b5db-d81c9850959f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:04.177218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-62883783-4073-4fd1-b5db-d81c9850959f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:04.185344 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-62883783-4073-4fd1-b5db-d81c9850959f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:04.187252 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-62883783-4073-4fd1-b5db-d81c9850959f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:04.188376 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-62883783-4073-4fd1-b5db-d81c9850959f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1281 microversion: 2.20 time: 0.086674 Aug 26 18:28:04.188976 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 314/623] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:04 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1281 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:04.229607 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2f67666a-9eae-440f-af12-69b5c5d4fe2c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:04.237752 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2f67666a-9eae-440f-af12-69b5c5d4fe2c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1319 microversion: 2.1 time: 0.447425 Aug 26 18:28:04.238325 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 310/624] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:03 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:04.293164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d3b0f33f-279d-4380-a127-5c09642e25c2 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:04.295678 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d3b0f33f-279d-4380-a127-5c09642e25c2 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:04.302326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3b0f33f-279d-4380-a127-5c09642e25c2 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:04.302925 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3b0f33f-279d-4380-a127-5c09642e25c2 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:04.303430 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3b0f33f-279d-4380-a127-5c09642e25c2 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:04.304206 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3b0f33f-279d-4380-a127-5c09642e25c2 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:04.304753 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3b0f33f-279d-4380-a127-5c09642e25c2 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:04.305265 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3b0f33f-279d-4380-a127-5c09642e25c2 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:04.339438 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d3b0f33f-279d-4380-a127-5c09642e25c2 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050240 Aug 26 18:28:04.340239 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 315/625] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:28:04 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 18:28:04.405599 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f84b3b88-68f9-46de-b94c-3efd2793cc4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:04.406152 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f84b3b88-68f9-46de-b94c-3efd2793cc4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:04.413190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f84b3b88-68f9-46de-b94c-3efd2793cc4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:04.413752 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f84b3b88-68f9-46de-b94c-3efd2793cc4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:04.414529 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f84b3b88-68f9-46de-b94c-3efd2793cc4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:04.415533 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f84b3b88-68f9-46de-b94c-3efd2793cc4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:04.416134 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f84b3b88-68f9-46de-b94c-3efd2793cc4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:04.416636 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f84b3b88-68f9-46de-b94c-3efd2793cc4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:04.445809 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f84b3b88-68f9-46de-b94c-3efd2793cc4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Going to try to terminate instance {{(pid=120540) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:28:04.546622 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f84b3b88-68f9-46de-b94c-3efd2793cc4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 204 len: 0 microversion: 2.1 time: 0.144321 Aug 26 18:28:04.547273 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 311/626] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:28:04 2022] DELETE /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:28:04.556070 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c8606433-bf31-47bc-9622-e24fc0633934 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:04.556976 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c8606433-bf31-47bc-9622-e24fc0633934 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:04.565571 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8606433-bf31-47bc-9622-e24fc0633934 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:04.566467 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8606433-bf31-47bc-9622-e24fc0633934 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:04.567310 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8606433-bf31-47bc-9622-e24fc0633934 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:04.568498 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8606433-bf31-47bc-9622-e24fc0633934 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:04.569304 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8606433-bf31-47bc-9622-e24fc0633934 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:04.570085 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8606433-bf31-47bc-9622-e24fc0633934 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:04.715226 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c8606433-bf31-47bc-9622-e24fc0633934 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:04.723718 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c8606433-bf31-47bc-9622-e24fc0633934 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1681 microversion: 2.1 time: 0.172071 Aug 26 18:28:04.724266 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 316/627] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:04 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:05.213001 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-6c148ba9-b008-4f5f-a9bf-5fc83513b24c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:05.213728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-6c148ba9-b008-4f5f-a9bf-5fc83513b24c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:05.220481 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c148ba9-b008-4f5f-a9bf-5fc83513b24c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:05.221001 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c148ba9-b008-4f5f-a9bf-5fc83513b24c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:05.221437 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c148ba9-b008-4f5f-a9bf-5fc83513b24c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:05.222161 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c148ba9-b008-4f5f-a9bf-5fc83513b24c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:05.222614 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c148ba9-b008-4f5f-a9bf-5fc83513b24c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:05.223039 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c148ba9-b008-4f5f-a9bf-5fc83513b24c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:05.259798 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c0538cca-c5b7-42b0-a2b8-83ea01675f7c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:05.260437 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c0538cca-c5b7-42b0-a2b8-83ea01675f7c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:05.267227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0538cca-c5b7-42b0-a2b8-83ea01675f7c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:05.267718 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0538cca-c5b7-42b0-a2b8-83ea01675f7c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:05.268133 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0538cca-c5b7-42b0-a2b8-83ea01675f7c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:05.268940 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0538cca-c5b7-42b0-a2b8-83ea01675f7c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:05.269377 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0538cca-c5b7-42b0-a2b8-83ea01675f7c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:05.269803 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0538cca-c5b7-42b0-a2b8-83ea01675f7c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:05.288755 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6c148ba9-b008-4f5f-a9bf-5fc83513b24c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:05.298195 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6c148ba9-b008-4f5f-a9bf-5fc83513b24c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:05.299721 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6c148ba9-b008-4f5f-a9bf-5fc83513b24c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:05.302412 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-6c148ba9-b008-4f5f-a9bf-5fc83513b24c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1285 microversion: 2.20 time: 0.092422 Aug 26 18:28:05.303098 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 312/628] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:05 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:05.410845 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c0538cca-c5b7-42b0-a2b8-83ea01675f7c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:05.419538 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c0538cca-c5b7-42b0-a2b8-83ea01675f7c tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1319 microversion: 2.1 time: 0.163648 Aug 26 18:28:05.420126 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 317/629] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:05 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:05.745024 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-69f7d26e-6076-49c4-bac9-ac7324082775 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:05.745620 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-69f7d26e-6076-49c4-bac9-ac7324082775 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:05.752480 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-69f7d26e-6076-49c4-bac9-ac7324082775 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:05.753050 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-69f7d26e-6076-49c4-bac9-ac7324082775 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:05.753548 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-69f7d26e-6076-49c4-bac9-ac7324082775 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:05.754322 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-69f7d26e-6076-49c4-bac9-ac7324082775 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:05.754834 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-69f7d26e-6076-49c4-bac9-ac7324082775 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:05.755298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-69f7d26e-6076-49c4-bac9-ac7324082775 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:05.900070 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-69f7d26e-6076-49c4-bac9-ac7324082775 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:05.908745 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-69f7d26e-6076-49c4-bac9-ac7324082775 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1681 microversion: 2.1 time: 0.167835 Aug 26 18:28:05.909372 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 313/630] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:05 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:06.022950 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-288985f2-a9d5-4123-afaf-2679ffd52914 req-5eeb17c1-1a0f-4af2-87e4-a80b8286c39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0208ae-2692-4fda-adb6-946c6cec83ae", "name": "network-vif-plugged", "status": "completed", "tag": "7f27addd-0afe-46bb-b1ec-6d8f2557e27c"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:06.040160 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-288985f2-a9d5-4123-afaf-2679ffd52914 req-5eeb17c1-1a0f-4af2-87e4-a80b8286c39c service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:06.041054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-288985f2-a9d5-4123-afaf-2679ffd52914 req-5eeb17c1-1a0f-4af2-87e4-a80b8286c39c service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:06.041915 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-288985f2-a9d5-4123-afaf-2679ffd52914 req-5eeb17c1-1a0f-4af2-87e4-a80b8286c39c service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:06.059116 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-288985f2-a9d5-4123-afaf-2679ffd52914 req-5eeb17c1-1a0f-4af2-87e4-a80b8286c39c service nova] Creating event network-vif-plugged:7f27addd-0afe-46bb-b1ec-6d8f2557e27c for instance 5b0208ae-2692-4fda-adb6-946c6cec83ae on hv-cinder-85199 Aug 26 18:28:06.064664 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-288985f2-a9d5-4123-afaf-2679ffd52914 req-5eeb17c1-1a0f-4af2-87e4-a80b8286c39c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046447 Aug 26 18:28:06.065669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 318/631] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:28:06.326775 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-a505fa80-dc0e-42e8-b64f-bfff6cde2e8c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:06.328015 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-a505fa80-dc0e-42e8-b64f-bfff6cde2e8c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:06.334809 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a505fa80-dc0e-42e8-b64f-bfff6cde2e8c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:06.335295 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a505fa80-dc0e-42e8-b64f-bfff6cde2e8c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:06.335743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a505fa80-dc0e-42e8-b64f-bfff6cde2e8c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:06.336455 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a505fa80-dc0e-42e8-b64f-bfff6cde2e8c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:06.336984 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a505fa80-dc0e-42e8-b64f-bfff6cde2e8c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:06.337401 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a505fa80-dc0e-42e8-b64f-bfff6cde2e8c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:06.409544 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a505fa80-dc0e-42e8-b64f-bfff6cde2e8c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:06.418111 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a505fa80-dc0e-42e8-b64f-bfff6cde2e8c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:06.419533 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a505fa80-dc0e-42e8-b64f-bfff6cde2e8c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:06.420645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-a505fa80-dc0e-42e8-b64f-bfff6cde2e8c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1333 microversion: 2.20 time: 0.098464 Aug 26 18:28:06.421242 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 314/632] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:06 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:06.440831 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab9b23ca-1c27-41db-9767-ec6de4e94682 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:06.441680 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ab9b23ca-1c27-41db-9767-ec6de4e94682 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:06.443764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:06.450443 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab9b23ca-1c27-41db-9767-ec6de4e94682 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:06.450947 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab9b23ca-1c27-41db-9767-ec6de4e94682 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:06.451392 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab9b23ca-1c27-41db-9767-ec6de4e94682 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:06.452098 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab9b23ca-1c27-41db-9767-ec6de4e94682 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:06.452565 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab9b23ca-1c27-41db-9767-ec6de4e94682 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:06.453085 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab9b23ca-1c27-41db-9767-ec6de4e94682 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:06.633754 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ab9b23ca-1c27-41db-9767-ec6de4e94682 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:06.642147 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ab9b23ca-1c27-41db-9767-ec6de4e94682 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1319 microversion: 2.1 time: 0.205545 Aug 26 18:28:06.642731 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 319/633] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:06 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:06.931580 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f1dc7f65-6535-4788-acce-c05018a988a0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:06.932196 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f1dc7f65-6535-4788-acce-c05018a988a0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:06.938561 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f1dc7f65-6535-4788-acce-c05018a988a0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:06.939192 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f1dc7f65-6535-4788-acce-c05018a988a0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:06.939639 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f1dc7f65-6535-4788-acce-c05018a988a0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:06.940358 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f1dc7f65-6535-4788-acce-c05018a988a0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:06.940930 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f1dc7f65-6535-4788-acce-c05018a988a0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:06.941455 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f1dc7f65-6535-4788-acce-c05018a988a0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:07.156251 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f1dc7f65-6535-4788-acce-c05018a988a0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:07.168078 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f1dc7f65-6535-4788-acce-c05018a988a0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1681 microversion: 2.1 time: 0.239979 Aug 26 18:28:07.169027 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 315/634] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:06 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:07.447222 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9be2f072-c3ec-4e1e-8295-2f7ba724d37e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:07.447853 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9be2f072-c3ec-4e1e-8295-2f7ba724d37e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:07.454718 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9be2f072-c3ec-4e1e-8295-2f7ba724d37e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:07.455208 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9be2f072-c3ec-4e1e-8295-2f7ba724d37e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:07.455719 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9be2f072-c3ec-4e1e-8295-2f7ba724d37e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:07.456436 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9be2f072-c3ec-4e1e-8295-2f7ba724d37e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:07.457095 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9be2f072-c3ec-4e1e-8295-2f7ba724d37e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:07.457512 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9be2f072-c3ec-4e1e-8295-2f7ba724d37e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:07.502363 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-04270a7a-5359-476e-8600-be49b194fc8d req-0925764f-0880-4bec-a97e-1e2a90918cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0359a4-7ac3-470c-8fe7-31ed2faab28b", "name": "network-vif-deleted", "tag": "0e69f390-da67-404b-8373-cd4efa3a40cb"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:07.512590 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-04270a7a-5359-476e-8600-be49b194fc8d req-0925764f-0880-4bec-a97e-1e2a90918cf9 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:07.513093 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-04270a7a-5359-476e-8600-be49b194fc8d req-0925764f-0880-4bec-a97e-1e2a90918cf9 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:07.513507 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-04270a7a-5359-476e-8600-be49b194fc8d req-0925764f-0880-4bec-a97e-1e2a90918cf9 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:07.527185 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-04270a7a-5359-476e-8600-be49b194fc8d req-0925764f-0880-4bec-a97e-1e2a90918cf9 service nova] Creating event network-vif-deleted:0e69f390-da67-404b-8373-cd4efa3a40cb for instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b on hv-cinder-85199 Aug 26 18:28:07.539277 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-04270a7a-5359-476e-8600-be49b194fc8d req-0925764f-0880-4bec-a97e-1e2a90918cf9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041017 Aug 26 18:28:07.543806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 316/635] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:07.554931 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9be2f072-c3ec-4e1e-8295-2f7ba724d37e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:07.568444 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9be2f072-c3ec-4e1e-8295-2f7ba724d37e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:07.570165 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9be2f072-c3ec-4e1e-8295-2f7ba724d37e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:07.571464 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9be2f072-c3ec-4e1e-8295-2f7ba724d37e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1333 microversion: 2.20 time: 0.131546 Aug 26 18:28:07.572063 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 320/636] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:07 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1333 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:07.677706 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c71c3e58-bfcb-4b18-aae2-f4b405c56c50 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:07.678862 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c71c3e58-bfcb-4b18-aae2-f4b405c56c50 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:07.697739 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c71c3e58-bfcb-4b18-aae2-f4b405c56c50 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:07.699281 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c71c3e58-bfcb-4b18-aae2-f4b405c56c50 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:07.700761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c71c3e58-bfcb-4b18-aae2-f4b405c56c50 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:07.703903 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c71c3e58-bfcb-4b18-aae2-f4b405c56c50 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:07.705121 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c71c3e58-bfcb-4b18-aae2-f4b405c56c50 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:07.706442 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c71c3e58-bfcb-4b18-aae2-f4b405c56c50 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:07.931611 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c71c3e58-bfcb-4b18-aae2-f4b405c56c50 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:07.942622 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c71c3e58-bfcb-4b18-aae2-f4b405c56c50 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1319 microversion: 2.1 time: 0.280783 Aug 26 18:28:07.943558 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 317/637] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:07 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:08.191062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-42e52701-de35-473a-ac1c-dfddbd1efae6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:08.191680 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-42e52701-de35-473a-ac1c-dfddbd1efae6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:08.198091 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42e52701-de35-473a-ac1c-dfddbd1efae6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:08.198566 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42e52701-de35-473a-ac1c-dfddbd1efae6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:08.199013 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42e52701-de35-473a-ac1c-dfddbd1efae6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:08.199731 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42e52701-de35-473a-ac1c-dfddbd1efae6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:08.200180 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42e52701-de35-473a-ac1c-dfddbd1efae6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:08.200599 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42e52701-de35-473a-ac1c-dfddbd1efae6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:08.235312 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42e52701-de35-473a-ac1c-dfddbd1efae6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:08.235843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42e52701-de35-473a-ac1c-dfddbd1efae6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:08.236280 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42e52701-de35-473a-ac1c-dfddbd1efae6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:08.236741 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-42e52701-de35-473a-ac1c-dfddbd1efae6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lazy-loading 'fault' on Instance uuid eb0359a4-7ac3-470c-8fe7-31ed2faab28b {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:28:08.280501 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-42e52701-de35-473a-ac1c-dfddbd1efae6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:08.283063 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:08.290771 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-42e52701-de35-473a-ac1c-dfddbd1efae6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 200 len: 1331 microversion: 2.1 time: 0.103292 Aug 26 18:28:08.291495 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 321/638] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:08 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:08.594201 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9e75ab7d-2830-47e1-ab5f-4362fe4d4540 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:08.594834 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9e75ab7d-2830-47e1-ab5f-4362fe4d4540 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:08.602018 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9e75ab7d-2830-47e1-ab5f-4362fe4d4540 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:08.602391 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9e75ab7d-2830-47e1-ab5f-4362fe4d4540 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:08.602883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9e75ab7d-2830-47e1-ab5f-4362fe4d4540 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:08.603628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9e75ab7d-2830-47e1-ab5f-4362fe4d4540 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:08.604099 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9e75ab7d-2830-47e1-ab5f-4362fe4d4540 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:08.608000 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9e75ab7d-2830-47e1-ab5f-4362fe4d4540 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:08.710941 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9e75ab7d-2830-47e1-ab5f-4362fe4d4540 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:08.719383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9e75ab7d-2830-47e1-ab5f-4362fe4d4540 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:08.720891 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9e75ab7d-2830-47e1-ab5f-4362fe4d4540 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:08.721983 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9e75ab7d-2830-47e1-ab5f-4362fe4d4540 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1339 microversion: 2.20 time: 0.131775 Aug 26 18:28:08.722541 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 318/639] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:08 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1339 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:08.979447 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f2322e87-6573-4c79-8fc1-1def785bce60 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:08.980747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f2322e87-6573-4c79-8fc1-1def785bce60 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:08.989237 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2322e87-6573-4c79-8fc1-1def785bce60 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:08.989822 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2322e87-6573-4c79-8fc1-1def785bce60 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:08.990465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2322e87-6573-4c79-8fc1-1def785bce60 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:08.991334 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2322e87-6573-4c79-8fc1-1def785bce60 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:08.991946 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2322e87-6573-4c79-8fc1-1def785bce60 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:08.992373 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2322e87-6573-4c79-8fc1-1def785bce60 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:09.162664 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f2322e87-6573-4c79-8fc1-1def785bce60 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:09.171783 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f2322e87-6573-4c79-8fc1-1def785bce60 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1508 microversion: 2.1 time: 0.196825 Aug 26 18:28:09.172365 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 322/640] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:08 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:09.194056 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-64c4d605-9fa0-43a7-b8ea-b5b70d7ac903 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61a03932-0dd3-49bb-b595-058ffd362c9c", "device": "/dev/sdb"}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:09.197214 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-64c4d605-9fa0-43a7-b8ea-b5b70d7ac903 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:09.204023 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64c4d605-9fa0-43a7-b8ea-b5b70d7ac903 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:09.204512 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64c4d605-9fa0-43a7-b8ea-b5b70d7ac903 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:09.204997 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64c4d605-9fa0-43a7-b8ea-b5b70d7ac903 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:09.205870 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64c4d605-9fa0-43a7-b8ea-b5b70d7ac903 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:09.206544 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64c4d605-9fa0-43a7-b8ea-b5b70d7ac903 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:09.207089 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64c4d605-9fa0-43a7-b8ea-b5b70d7ac903 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:09.316035 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e469a38e-e638-402d-b64e-08fc73dd1f1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:09.317048 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e469a38e-e638-402d-b64e-08fc73dd1f1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:09.324221 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e469a38e-e638-402d-b64e-08fc73dd1f1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:09.325150 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e469a38e-e638-402d-b64e-08fc73dd1f1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:09.325584 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e469a38e-e638-402d-b64e-08fc73dd1f1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:09.326304 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e469a38e-e638-402d-b64e-08fc73dd1f1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:09.326830 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e469a38e-e638-402d-b64e-08fc73dd1f1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:09.327272 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e469a38e-e638-402d-b64e-08fc73dd1f1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:09.352302 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-e469a38e-e638-402d-b64e-08fc73dd1f1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] HTTP exception thrown: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e469a38e-e638-402d-b64e-08fc73dd1f1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Request method failure captured: Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b HTTP/1.1 Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ_7WV4eHbAqOpnTYkwFP6-jB3HCDjeZbl0R247dr5RR1y2TCZ3q7yJc3wAkX4naY95SpgiF97bav2cRanoMnEaxUU8VKQlnKSHzILsN-blIL91h5HmfvqVCwXlIyEUHdZjNlc9SaFqhXfX303L2e3MPsBKCAHoO-gSYEI6n3TQjqMw Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:28:09.354806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:28:09.356372 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_67f4fd75428040ab9ff8a0458e4708fb", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/67f4fd75428040ab9ff8a0458e4708fb"}]}] Aug 26 18:28:09.356372 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:28:09.356372 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:28:09.356372 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:28:09.356372 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:28:09.356372 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:28:09.356372 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:28:09.356372 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: a1be02f9e7fd4bdabc05ec48e2a35f56 Aug 26 18:28:09.356372 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:28:09.356372 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:28:09.356372 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. Aug 26 18:28:09.356372 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': 'eb0359a4-7ac3-470c-8fe7-31ed2faab28b'} Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:28:09.357326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. Aug 26 18:28:09.359194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:09.361439 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e469a38e-e638-402d-b64e-08fc73dd1f1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Returning 404 to user: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:28:09.362476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e469a38e-e638-402d-b64e-08fc73dd1f1d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 404 len: 111 microversion: 2.1 time: 0.052549 Aug 26 18:28:09.363201 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 323/641] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:09 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 18:28:09.373276 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-433c3552-decd-4f53-af34-ee96500f83fa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '.version_select at 0x7fc7441005e0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:09.412225 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-433c3552-decd-4f53-af34-ee96500f83fa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064446139" status: 202 len: 0 microversion: 2.1 time: 0.043520 Aug 26 18:28:09.413830 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 324/642] 10.222.0.45 () {58 vars in 1221 bytes} [Fri Aug 26 18:28:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064446139 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 18:28:09.527858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-64c4d605-9fa0-43a7-b8ea-b5b70d7ac903 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "POST /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337353 Aug 26 18:28:09.529016 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 319/643] 10.222.0.45 () {60 vars in 1323 bytes} [Fri Aug 26 18:28:09 2022] POST /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:09.746844 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8b7acae5-ff0d-47a9-a306-5829c1ad7355 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:09.747469 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8b7acae5-ff0d-47a9-a306-5829c1ad7355 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:09.753615 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b7acae5-ff0d-47a9-a306-5829c1ad7355 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:09.754098 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b7acae5-ff0d-47a9-a306-5829c1ad7355 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:09.754531 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b7acae5-ff0d-47a9-a306-5829c1ad7355 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:09.755371 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b7acae5-ff0d-47a9-a306-5829c1ad7355 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:09.755815 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b7acae5-ff0d-47a9-a306-5829c1ad7355 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:09.756527 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b7acae5-ff0d-47a9-a306-5829c1ad7355 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:09.903643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8b7acae5-ff0d-47a9-a306-5829c1ad7355 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:09.913477 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8b7acae5-ff0d-47a9-a306-5829c1ad7355 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:09.915204 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8b7acae5-ff0d-47a9-a306-5829c1ad7355 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:09.916753 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8b7acae5-ff0d-47a9-a306-5829c1ad7355 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1407 microversion: 2.20 time: 0.173685 Aug 26 18:28:09.917441 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 325/644] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:09 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:10.329859 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-344e3be5-31d3-4107-b754-f544e6d966e5 req-cdba62af-1298-488c-bec6-f99725b6e3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f82d25b8-bf09-48ca-9098-20bff440e163", "tag": "9120b3ad-b9e1-459d-b90c-56a0a48c2f3d"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:10.342556 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-344e3be5-31d3-4107-b754-f544e6d966e5 req-cdba62af-1298-488c-bec6-f99725b6e3a5 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:10.343034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-344e3be5-31d3-4107-b754-f544e6d966e5 req-cdba62af-1298-488c-bec6-f99725b6e3a5 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:10.343462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-344e3be5-31d3-4107-b754-f544e6d966e5 req-cdba62af-1298-488c-bec6-f99725b6e3a5 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:10.355935 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-344e3be5-31d3-4107-b754-f544e6d966e5 req-cdba62af-1298-488c-bec6-f99725b6e3a5 service nova] Creating event network-changed:9120b3ad-b9e1-459d-b90c-56a0a48c2f3d for instance f82d25b8-bf09-48ca-9098-20bff440e163 on hv-cinder-85199 Aug 26 18:28:10.361317 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-344e3be5-31d3-4107-b754-f544e6d966e5 req-cdba62af-1298-488c-bec6-f99725b6e3a5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041494 Aug 26 18:28:10.362246 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 320/645] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:10.488185 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6d012fb3-3444-46e4-9453-be0f62027dcf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Action: 'create', calling method: .version_select at 0x7fc745a74f70>, body: {"keypair": {"name": "tempest-keypair-231341577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmu9A/6ukzFofmkQ+XoWZJwb5HQ0AznXG5lLrlla79UL7JEjaEu4MbphEqYtmPoi5SPp8L62ejNN0l6tz4SxG+R6BWp3Az4KaQgmm2q5/yiiz4fel6eLGrmeHjMWAhG9A=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:10.509895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-6d012fb3-3444-46e4-9453-be0f62027dcf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:28:10.513932 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-6d012fb3-3444-46e4-9453-be0f62027dcf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for user a1be02f9e7fd4bdabc05ec48e2a35f56 and project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:28:10.544591 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6d012fb3-3444-46e4-9453-be0f62027dcf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060279 Aug 26 18:28:10.545238 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 326/646] 10.222.0.45 () {60 vars in 1159 bytes} [Fri Aug 26 18:28:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:10.940656 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-93e6c1ac-3162-4bfc-8c74-d2ae945f094d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:10.941624 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-93e6c1ac-3162-4bfc-8c74-d2ae945f094d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:10.949137 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e6c1ac-3162-4bfc-8c74-d2ae945f094d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:10.949717 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e6c1ac-3162-4bfc-8c74-d2ae945f094d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:10.950217 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e6c1ac-3162-4bfc-8c74-d2ae945f094d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:10.951356 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e6c1ac-3162-4bfc-8c74-d2ae945f094d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:10.951804 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e6c1ac-3162-4bfc-8c74-d2ae945f094d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:10.952296 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e6c1ac-3162-4bfc-8c74-d2ae945f094d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:11.147683 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-93e6c1ac-3162-4bfc-8c74-d2ae945f094d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:11.156814 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-93e6c1ac-3162-4bfc-8c74-d2ae945f094d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:11.158289 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-93e6c1ac-3162-4bfc-8c74-d2ae945f094d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:11.159369 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-93e6c1ac-3162-4bfc-8c74-d2ae945f094d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1407 microversion: 2.20 time: 0.223650 Aug 26 18:28:11.166330 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 321/647] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:10 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:12.194153 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d0e5bfb-30b8-4ca4-9e69-9f4e16f74ee3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:12.194778 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7d0e5bfb-30b8-4ca4-9e69-9f4e16f74ee3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:12.201798 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d0e5bfb-30b8-4ca4-9e69-9f4e16f74ee3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:12.202293 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d0e5bfb-30b8-4ca4-9e69-9f4e16f74ee3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:12.202734 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d0e5bfb-30b8-4ca4-9e69-9f4e16f74ee3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:12.203508 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d0e5bfb-30b8-4ca4-9e69-9f4e16f74ee3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:12.203962 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d0e5bfb-30b8-4ca4-9e69-9f4e16f74ee3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:12.204388 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d0e5bfb-30b8-4ca4-9e69-9f4e16f74ee3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:12.287431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2094052905", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d4880b7-d8b8-43ef-a723-cbc27eb026db"}], "security_groups": [{"name": "tempest-securitygroup--1394301465"}], "key_name": "tempest-keypair-231341577", "user_data": "}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:12.352092 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7d0e5bfb-30b8-4ca4-9e69-9f4e16f74ee3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:12.361189 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7d0e5bfb-30b8-4ca4-9e69-9f4e16f74ee3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:12.362876 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7d0e5bfb-30b8-4ca4-9e69-9f4e16f74ee3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:12.364120 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7d0e5bfb-30b8-4ca4-9e69-9f4e16f74ee3 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1407 microversion: 2.20 time: 0.175843 Aug 26 18:28:12.364867 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 327/648] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:12 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:12.419844 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.network.neutron [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] validate_networks() for [('2d4880b7-d8b8-43ef-a723-cbc27eb026db', None, None, None, None, None)] {{(pid=120540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:28:13.026364 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Flavor limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:28:13.026364 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Image limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:28:13.026364 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Flavor pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:28:13.026912 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Image pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:28:13.027331 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:28:13.036977 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:13.037495 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:13.037959 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:13.038713 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:13.039164 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:13.039584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:13.056487 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:28:13.060667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for user a1be02f9e7fd4bdabc05ec48e2a35f56 and project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:28:13.072280 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Going to run 1 instances... {{(pid=120540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:28:13.074638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:28:13.123624 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-dbd6d8f9-73d4-4519-93bd-faa4c32217f3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.843446 Aug 26 18:28:13.124321 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 322/649] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:28:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 18:28:13.135866 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-04c2b6c6-7439-493d-b09b-39ca30d1a126 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:13.136424 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-04c2b6c6-7439-493d-b09b-39ca30d1a126 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:13.191899 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-04c2b6c6-7439-493d-b09b-39ca30d1a126 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:13.200167 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-04c2b6c6-7439-493d-b09b-39ca30d1a126 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1241 microversion: 2.1 time: 0.068428 Aug 26 18:28:13.200795 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 328/650] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:13 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:13.390971 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2dae1270-2c59-4d14-9fc5-37cb3594da38 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:13.391628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2dae1270-2c59-4d14-9fc5-37cb3594da38 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:13.393849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:13.400879 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2dae1270-2c59-4d14-9fc5-37cb3594da38 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:13.401425 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2dae1270-2c59-4d14-9fc5-37cb3594da38 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:13.402015 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2dae1270-2c59-4d14-9fc5-37cb3594da38 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:13.402781 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2dae1270-2c59-4d14-9fc5-37cb3594da38 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:13.403304 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2dae1270-2c59-4d14-9fc5-37cb3594da38 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:13.403745 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2dae1270-2c59-4d14-9fc5-37cb3594da38 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:13.570875 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2dae1270-2c59-4d14-9fc5-37cb3594da38 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:13.579755 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2dae1270-2c59-4d14-9fc5-37cb3594da38 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:13.581302 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2dae1270-2c59-4d14-9fc5-37cb3594da38 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:13.582447 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2dae1270-2c59-4d14-9fc5-37cb3594da38 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1407 microversion: 2.20 time: 0.196933 Aug 26 18:28:13.583027 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 323/651] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:13 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:14.221734 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4a36f996-21a5-4a5a-8a43-429ccbb87c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:14.222319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4a36f996-21a5-4a5a-8a43-429ccbb87c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:14.224146 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:14.231187 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a36f996-21a5-4a5a-8a43-429ccbb87c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:14.231703 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a36f996-21a5-4a5a-8a43-429ccbb87c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:14.232139 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a36f996-21a5-4a5a-8a43-429ccbb87c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:14.232870 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a36f996-21a5-4a5a-8a43-429ccbb87c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:14.233321 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a36f996-21a5-4a5a-8a43-429ccbb87c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:14.233770 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a36f996-21a5-4a5a-8a43-429ccbb87c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:14.297727 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4a36f996-21a5-4a5a-8a43-429ccbb87c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:14.306393 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4a36f996-21a5-4a5a-8a43-429ccbb87c3b tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1293 microversion: 2.1 time: 0.088763 Aug 26 18:28:14.307605 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 329/652] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:14 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:14.604457 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-b89d8ad5-8a9f-46b2-a0c8-0d514ed25161 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:14.605098 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-b89d8ad5-8a9f-46b2-a0c8-0d514ed25161 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:14.612929 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b89d8ad5-8a9f-46b2-a0c8-0d514ed25161 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:14.613405 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b89d8ad5-8a9f-46b2-a0c8-0d514ed25161 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:14.613993 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b89d8ad5-8a9f-46b2-a0c8-0d514ed25161 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:14.614683 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b89d8ad5-8a9f-46b2-a0c8-0d514ed25161 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:14.615150 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b89d8ad5-8a9f-46b2-a0c8-0d514ed25161 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:14.615662 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b89d8ad5-8a9f-46b2-a0c8-0d514ed25161 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:14.821739 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b89d8ad5-8a9f-46b2-a0c8-0d514ed25161 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:14.826278 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:14.832447 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b89d8ad5-8a9f-46b2-a0c8-0d514ed25161 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:14.833954 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b89d8ad5-8a9f-46b2-a0c8-0d514ed25161 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:14.835084 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-b89d8ad5-8a9f-46b2-a0c8-0d514ed25161 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1407 microversion: 2.20 time: 0.234605 Aug 26 18:28:14.835808 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 324/653] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:14 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:14.953206 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8392bf1c-52f7-4c32-ba7c-846b7b15e2f8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:14.955383 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8392bf1c-52f7-4c32-ba7c-846b7b15e2f8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:14.961399 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8392bf1c-52f7-4c32-ba7c-846b7b15e2f8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:14.961872 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8392bf1c-52f7-4c32-ba7c-846b7b15e2f8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:14.962297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8392bf1c-52f7-4c32-ba7c-846b7b15e2f8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:14.962985 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8392bf1c-52f7-4c32-ba7c-846b7b15e2f8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:14.963429 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8392bf1c-52f7-4c32-ba7c-846b7b15e2f8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:14.963839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8392bf1c-52f7-4c32-ba7c-846b7b15e2f8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:14.995260 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8392bf1c-52f7-4c32-ba7c-846b7b15e2f8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046094 Aug 26 18:28:14.995822 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 330/654] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:28:14 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 18:28:15.058195 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-389c7246-f203-46cd-98a5-09ec4409828d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:15.059425 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-389c7246-f203-46cd-98a5-09ec4409828d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:15.067372 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-389c7246-f203-46cd-98a5-09ec4409828d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:15.068074 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-389c7246-f203-46cd-98a5-09ec4409828d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:15.068501 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-389c7246-f203-46cd-98a5-09ec4409828d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:15.069277 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-389c7246-f203-46cd-98a5-09ec4409828d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:15.069659 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-389c7246-f203-46cd-98a5-09ec4409828d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:15.070067 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-389c7246-f203-46cd-98a5-09ec4409828d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:15.096162 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-389c7246-f203-46cd-98a5-09ec4409828d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Going to try to terminate instance {{(pid=120540) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:28:15.177298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-389c7246-f203-46cd-98a5-09ec4409828d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "DELETE /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 204 len: 0 microversion: 2.1 time: 0.122723 Aug 26 18:28:15.177908 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 325/655] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:28:15 2022] DELETE /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 18:28:15.186400 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e3b25875-925e-4884-bde2-e0f5623879e6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:15.187078 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e3b25875-925e-4884-bde2-e0f5623879e6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:15.193519 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3b25875-925e-4884-bde2-e0f5623879e6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:15.194013 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3b25875-925e-4884-bde2-e0f5623879e6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:15.194447 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3b25875-925e-4884-bde2-e0f5623879e6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:15.195150 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3b25875-925e-4884-bde2-e0f5623879e6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:15.195602 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3b25875-925e-4884-bde2-e0f5623879e6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:15.196026 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3b25875-925e-4884-bde2-e0f5623879e6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:15.332048 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2e25c1a9-7005-4d3a-8caf-87ce30748ec5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:15.334005 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2e25c1a9-7005-4d3a-8caf-87ce30748ec5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:15.339462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2e25c1a9-7005-4d3a-8caf-87ce30748ec5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:15.340051 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2e25c1a9-7005-4d3a-8caf-87ce30748ec5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:15.340323 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2e25c1a9-7005-4d3a-8caf-87ce30748ec5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:15.341135 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2e25c1a9-7005-4d3a-8caf-87ce30748ec5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:15.341673 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2e25c1a9-7005-4d3a-8caf-87ce30748ec5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:15.342192 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2e25c1a9-7005-4d3a-8caf-87ce30748ec5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:15.357730 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e3b25875-925e-4884-bde2-e0f5623879e6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:15.366395 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e3b25875-925e-4884-bde2-e0f5623879e6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1675 microversion: 2.1 time: 0.183770 Aug 26 18:28:15.380349 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 331/656] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:15 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:15.507223 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2e25c1a9-7005-4d3a-8caf-87ce30748ec5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:15.516256 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2e25c1a9-7005-4d3a-8caf-87ce30748ec5 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.188856 Aug 26 18:28:15.516907 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 326/657] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:15 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:15.860563 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-242b0284-35a5-4bde-a751-bca3fb9d7f12 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:15.861225 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-242b0284-35a5-4bde-a751-bca3fb9d7f12 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:15.868042 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-242b0284-35a5-4bde-a751-bca3fb9d7f12 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:15.868572 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-242b0284-35a5-4bde-a751-bca3fb9d7f12 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:15.869036 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-242b0284-35a5-4bde-a751-bca3fb9d7f12 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:15.869751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-242b0284-35a5-4bde-a751-bca3fb9d7f12 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:15.870204 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-242b0284-35a5-4bde-a751-bca3fb9d7f12 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:15.870693 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-242b0284-35a5-4bde-a751-bca3fb9d7f12 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:16.009252 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-242b0284-35a5-4bde-a751-bca3fb9d7f12 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:16.017589 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-242b0284-35a5-4bde-a751-bca3fb9d7f12 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:16.019029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-242b0284-35a5-4bde-a751-bca3fb9d7f12 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:16.020154 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-242b0284-35a5-4bde-a751-bca3fb9d7f12 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1407 microversion: 2.20 time: 0.164323 Aug 26 18:28:16.020696 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 332/658] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:15 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:16.054663 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-19904a66-401f-4e52-83bc-81d9f381b87e req-06d0f8f2-8df6-4fa2-8330-1f89c2b0f31c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82d25b8-bf09-48ca-9098-20bff440e163", "name": "network-vif-plugged", "status": "completed", "tag": "9120b3ad-b9e1-459d-b90c-56a0a48c2f3d"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:16.064633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-19904a66-401f-4e52-83bc-81d9f381b87e req-06d0f8f2-8df6-4fa2-8330-1f89c2b0f31c service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:16.065164 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-19904a66-401f-4e52-83bc-81d9f381b87e req-06d0f8f2-8df6-4fa2-8330-1f89c2b0f31c service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:16.065593 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-19904a66-401f-4e52-83bc-81d9f381b87e req-06d0f8f2-8df6-4fa2-8330-1f89c2b0f31c service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:16.077272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-19904a66-401f-4e52-83bc-81d9f381b87e req-06d0f8f2-8df6-4fa2-8330-1f89c2b0f31c service nova] Creating event network-vif-plugged:9120b3ad-b9e1-459d-b90c-56a0a48c2f3d for instance f82d25b8-bf09-48ca-9098-20bff440e163 on hv-cinder-85199 Aug 26 18:28:16.082278 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-19904a66-401f-4e52-83bc-81d9f381b87e req-06d0f8f2-8df6-4fa2-8330-1f89c2b0f31c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031677 Aug 26 18:28:16.082881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 327/659] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:16.387914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eed6b090-e6bd-445c-9f7e-031bade9849a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:16.388428 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eed6b090-e6bd-445c-9f7e-031bade9849a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:16.395597 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eed6b090-e6bd-445c-9f7e-031bade9849a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:16.396087 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eed6b090-e6bd-445c-9f7e-031bade9849a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:16.396554 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eed6b090-e6bd-445c-9f7e-031bade9849a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:16.397677 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eed6b090-e6bd-445c-9f7e-031bade9849a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:16.397780 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eed6b090-e6bd-445c-9f7e-031bade9849a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:16.398198 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eed6b090-e6bd-445c-9f7e-031bade9849a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:16.539087 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-99cabffd-32ea-451f-8cbe-b7fab1dc115f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:16.540037 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-99cabffd-32ea-451f-8cbe-b7fab1dc115f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:16.540944 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eed6b090-e6bd-445c-9f7e-031bade9849a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:16.546933 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-99cabffd-32ea-451f-8cbe-b7fab1dc115f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:16.547443 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-99cabffd-32ea-451f-8cbe-b7fab1dc115f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:16.547916 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-99cabffd-32ea-451f-8cbe-b7fab1dc115f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:16.548700 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-99cabffd-32ea-451f-8cbe-b7fab1dc115f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:16.549199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-99cabffd-32ea-451f-8cbe-b7fab1dc115f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:16.549704 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-99cabffd-32ea-451f-8cbe-b7fab1dc115f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:16.549879 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eed6b090-e6bd-445c-9f7e-031bade9849a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1675 microversion: 2.1 time: 0.166029 Aug 26 18:28:16.550438 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 333/660] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:16 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:16.689253 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-99cabffd-32ea-451f-8cbe-b7fab1dc115f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:16.698395 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-99cabffd-32ea-451f-8cbe-b7fab1dc115f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.163878 Aug 26 18:28:16.699093 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 328/661] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:16 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:17.042503 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c73bb7f8-aea1-4e15-b768-c20f3bf122d0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:17.043112 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c73bb7f8-aea1-4e15-b768-c20f3bf122d0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:17.049303 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c73bb7f8-aea1-4e15-b768-c20f3bf122d0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:17.049850 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c73bb7f8-aea1-4e15-b768-c20f3bf122d0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:17.050287 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c73bb7f8-aea1-4e15-b768-c20f3bf122d0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:17.050972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c73bb7f8-aea1-4e15-b768-c20f3bf122d0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:17.051420 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c73bb7f8-aea1-4e15-b768-c20f3bf122d0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:17.051857 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c73bb7f8-aea1-4e15-b768-c20f3bf122d0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:17.181397 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c73bb7f8-aea1-4e15-b768-c20f3bf122d0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:17.190321 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c73bb7f8-aea1-4e15-b768-c20f3bf122d0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:17.192456 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c73bb7f8-aea1-4e15-b768-c20f3bf122d0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:17.194034 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c73bb7f8-aea1-4e15-b768-c20f3bf122d0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1407 microversion: 2.20 time: 0.155422 Aug 26 18:28:17.195017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 334/662] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:17 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:17.574642 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-da739e52-e33e-4a07-9bdd-4bc9c1696258 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:17.576261 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-da739e52-e33e-4a07-9bdd-4bc9c1696258 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:17.586397 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-da739e52-e33e-4a07-9bdd-4bc9c1696258 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:17.587045 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-da739e52-e33e-4a07-9bdd-4bc9c1696258 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:17.587975 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-da739e52-e33e-4a07-9bdd-4bc9c1696258 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:17.589061 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-da739e52-e33e-4a07-9bdd-4bc9c1696258 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:17.589514 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-da739e52-e33e-4a07-9bdd-4bc9c1696258 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:17.589934 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-da739e52-e33e-4a07-9bdd-4bc9c1696258 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:17.721083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bca050e1-7d44-41c8-aedc-91e1d99d462e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:17.721728 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bca050e1-7d44-41c8-aedc-91e1d99d462e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:17.728627 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bca050e1-7d44-41c8-aedc-91e1d99d462e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:17.729222 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bca050e1-7d44-41c8-aedc-91e1d99d462e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:17.729696 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bca050e1-7d44-41c8-aedc-91e1d99d462e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:17.730467 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bca050e1-7d44-41c8-aedc-91e1d99d462e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:17.730993 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bca050e1-7d44-41c8-aedc-91e1d99d462e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:17.731482 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bca050e1-7d44-41c8-aedc-91e1d99d462e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:17.870003 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-da739e52-e33e-4a07-9bdd-4bc9c1696258 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:17.875770 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bca050e1-7d44-41c8-aedc-91e1d99d462e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:17.879706 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-da739e52-e33e-4a07-9bdd-4bc9c1696258 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1675 microversion: 2.1 time: 0.311336 Aug 26 18:28:17.880495 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 329/663] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:17 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1675 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:17.884728 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bca050e1-7d44-41c8-aedc-91e1d99d462e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.167570 Aug 26 18:28:17.885411 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 335/664] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:17 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:18.219123 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c6b693ab-5e53-4ff0-bfee-e614604f45f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:18.219743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c6b693ab-5e53-4ff0-bfee-e614604f45f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:18.226159 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6b693ab-5e53-4ff0-bfee-e614604f45f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:18.226648 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6b693ab-5e53-4ff0-bfee-e614604f45f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:18.227080 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6b693ab-5e53-4ff0-bfee-e614604f45f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:18.227782 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6b693ab-5e53-4ff0-bfee-e614604f45f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:18.228450 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6b693ab-5e53-4ff0-bfee-e614604f45f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:18.229060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c6b693ab-5e53-4ff0-bfee-e614604f45f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:18.350824 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-00ca8b88-8886-445d-a6f3-2271d7cb321b req-2b5b306a-781c-4ea6-ae5f-8684d865a887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbde000-0844-4305-9309-31a6e53167a7", "tag": "be9a00ea-a696-4aaa-be11-b5198ea1bb36"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:18.363051 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-00ca8b88-8886-445d-a6f3-2271d7cb321b req-2b5b306a-781c-4ea6-ae5f-8684d865a887 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:18.363051 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-00ca8b88-8886-445d-a6f3-2271d7cb321b req-2b5b306a-781c-4ea6-ae5f-8684d865a887 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:18.363051 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-00ca8b88-8886-445d-a6f3-2271d7cb321b req-2b5b306a-781c-4ea6-ae5f-8684d865a887 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:18.376243 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-00ca8b88-8886-445d-a6f3-2271d7cb321b req-2b5b306a-781c-4ea6-ae5f-8684d865a887 service nova] Creating event network-changed:be9a00ea-a696-4aaa-be11-b5198ea1bb36 for instance 4cbde000-0844-4305-9309-31a6e53167a7 on hv-cinder-85199 Aug 26 18:28:18.381749 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-00ca8b88-8886-445d-a6f3-2271d7cb321b req-2b5b306a-781c-4ea6-ae5f-8684d865a887 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034898 Aug 26 18:28:18.382392 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 336/665] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:18.440265 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c6b693ab-5e53-4ff0-bfee-e614604f45f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:18.448710 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c6b693ab-5e53-4ff0-bfee-e614604f45f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:18.450283 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c6b693ab-5e53-4ff0-bfee-e614604f45f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:18.451728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c6b693ab-5e53-4ff0-bfee-e614604f45f2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1407 microversion: 2.20 time: 0.236833 Aug 26 18:28:18.452375 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 330/666] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:18 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:18.902812 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-602bb822-a746-4f6f-883c-b0fd49b481aa tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:18.903396 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-602bb822-a746-4f6f-883c-b0fd49b481aa tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:18.905926 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-34edc8e0-92b0-426d-9701-0ba454760c44 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:18.906650 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-34edc8e0-92b0-426d-9701-0ba454760c44 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:18.911097 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-602bb822-a746-4f6f-883c-b0fd49b481aa tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:18.911588 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-602bb822-a746-4f6f-883c-b0fd49b481aa tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:18.911996 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-602bb822-a746-4f6f-883c-b0fd49b481aa tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:18.912706 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-602bb822-a746-4f6f-883c-b0fd49b481aa tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:18.913364 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-602bb822-a746-4f6f-883c-b0fd49b481aa tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:18.913810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-602bb822-a746-4f6f-883c-b0fd49b481aa tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:18.914369 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-34edc8e0-92b0-426d-9701-0ba454760c44 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:18.915020 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-34edc8e0-92b0-426d-9701-0ba454760c44 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:18.915545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-34edc8e0-92b0-426d-9701-0ba454760c44 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:18.916324 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-34edc8e0-92b0-426d-9701-0ba454760c44 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:18.917625 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-34edc8e0-92b0-426d-9701-0ba454760c44 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:18.918054 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-34edc8e0-92b0-426d-9701-0ba454760c44 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:19.062856 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-602bb822-a746-4f6f-883c-b0fd49b481aa tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:19.071288 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-602bb822-a746-4f6f-883c-b0fd49b481aa tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1675 microversion: 2.1 time: 0.173948 Aug 26 18:28:19.071876 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 337/667] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:18 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:19.212848 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-34edc8e0-92b0-426d-9701-0ba454760c44 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:19.221129 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-34edc8e0-92b0-426d-9701-0ba454760c44 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.319077 Aug 26 18:28:19.233327 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 331/668] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:18 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:19.475114 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b2fb31b9-dc46-4de3-81e1-cfbfb1c19520 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:19.475806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b2fb31b9-dc46-4de3-81e1-cfbfb1c19520 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:19.482711 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2fb31b9-dc46-4de3-81e1-cfbfb1c19520 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:19.483234 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2fb31b9-dc46-4de3-81e1-cfbfb1c19520 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:19.483728 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2fb31b9-dc46-4de3-81e1-cfbfb1c19520 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:19.484553 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2fb31b9-dc46-4de3-81e1-cfbfb1c19520 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:19.485077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2fb31b9-dc46-4de3-81e1-cfbfb1c19520 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:19.485547 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2fb31b9-dc46-4de3-81e1-cfbfb1c19520 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:19.656236 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b2fb31b9-dc46-4de3-81e1-cfbfb1c19520 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:19.665237 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b2fb31b9-dc46-4de3-81e1-cfbfb1c19520 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:19.666572 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b2fb31b9-dc46-4de3-81e1-cfbfb1c19520 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:19.667676 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b2fb31b9-dc46-4de3-81e1-cfbfb1c19520 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1407 microversion: 2.20 time: 0.196864 Aug 26 18:28:19.668246 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 338/669] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:19 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:20.093849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-44f1b381-682b-4aaf-b279-23f59c4b2eed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:20.094578 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-44f1b381-682b-4aaf-b279-23f59c4b2eed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:20.101911 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-44f1b381-682b-4aaf-b279-23f59c4b2eed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:20.102405 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-44f1b381-682b-4aaf-b279-23f59c4b2eed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:20.102834 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-44f1b381-682b-4aaf-b279-23f59c4b2eed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:20.103525 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-44f1b381-682b-4aaf-b279-23f59c4b2eed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:20.103970 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-44f1b381-682b-4aaf-b279-23f59c4b2eed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:20.104389 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-44f1b381-682b-4aaf-b279-23f59c4b2eed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:20.174745 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-44f1b381-682b-4aaf-b279-23f59c4b2eed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:20.182920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-44f1b381-682b-4aaf-b279-23f59c4b2eed tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1608 microversion: 2.1 time: 0.092987 Aug 26 18:28:20.183523 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 332/670] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:20 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1608 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:20.243003 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-14c8840d-889a-49da-90b5-7bc6c5fa628a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:20.243778 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-14c8840d-889a-49da-90b5-7bc6c5fa628a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:20.250545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c8840d-889a-49da-90b5-7bc6c5fa628a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:20.251024 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c8840d-889a-49da-90b5-7bc6c5fa628a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:20.251451 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c8840d-889a-49da-90b5-7bc6c5fa628a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:20.252172 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c8840d-889a-49da-90b5-7bc6c5fa628a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:20.252616 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c8840d-889a-49da-90b5-7bc6c5fa628a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:20.253068 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c8840d-889a-49da-90b5-7bc6c5fa628a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:20.402925 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-14c8840d-889a-49da-90b5-7bc6c5fa628a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:20.404395 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-ea4f4528-f9a1-4ace-b3ad-79c7e577fde2 req-7a615982-0ac2-4d8a-a5e5-73842131002a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "024e8a0f-0670-4aec-8ec6-e8afbc67d464", "name": "network-vif-deleted", "tag": "a2a7330d-44fd-4799-ab35-6c1aa82dab95"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:20.416527 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-14c8840d-889a-49da-90b5-7bc6c5fa628a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.177310 Aug 26 18:28:20.419241 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 339/671] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:20 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:20.430044 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ea4f4528-f9a1-4ace-b3ad-79c7e577fde2 req-7a615982-0ac2-4d8a-a5e5-73842131002a service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:20.430532 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ea4f4528-f9a1-4ace-b3ad-79c7e577fde2 req-7a615982-0ac2-4d8a-a5e5-73842131002a service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:20.430964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ea4f4528-f9a1-4ace-b3ad-79c7e577fde2 req-7a615982-0ac2-4d8a-a5e5-73842131002a service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:20.447551 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-ea4f4528-f9a1-4ace-b3ad-79c7e577fde2 req-7a615982-0ac2-4d8a-a5e5-73842131002a service nova] Creating event network-vif-deleted:a2a7330d-44fd-4799-ab35-6c1aa82dab95 for instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 on hv-cinder-85199 Aug 26 18:28:20.457594 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-ea4f4528-f9a1-4ace-b3ad-79c7e577fde2 req-7a615982-0ac2-4d8a-a5e5-73842131002a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061363 Aug 26 18:28:20.457594 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 333/672] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:20.696076 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d244af25-e57c-4093-8cbd-991f53ecbf4c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:20.696755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d244af25-e57c-4093-8cbd-991f53ecbf4c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:20.703784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d244af25-e57c-4093-8cbd-991f53ecbf4c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:20.704259 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d244af25-e57c-4093-8cbd-991f53ecbf4c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:20.704687 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d244af25-e57c-4093-8cbd-991f53ecbf4c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:20.705401 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d244af25-e57c-4093-8cbd-991f53ecbf4c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:20.705844 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d244af25-e57c-4093-8cbd-991f53ecbf4c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:20.706252 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d244af25-e57c-4093-8cbd-991f53ecbf4c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:20.845352 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d244af25-e57c-4093-8cbd-991f53ecbf4c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:20.853805 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d244af25-e57c-4093-8cbd-991f53ecbf4c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:20.855219 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d244af25-e57c-4093-8cbd-991f53ecbf4c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:20.856302 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d244af25-e57c-4093-8cbd-991f53ecbf4c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1407 microversion: 2.20 time: 0.164573 Aug 26 18:28:20.856905 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 340/673] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:20 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:21.204921 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-64ea2a51-6267-47be-ad85-71383a743190 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:21.205577 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-64ea2a51-6267-47be-ad85-71383a743190 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:21.212319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64ea2a51-6267-47be-ad85-71383a743190 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:21.212806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64ea2a51-6267-47be-ad85-71383a743190 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:21.213228 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64ea2a51-6267-47be-ad85-71383a743190 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:21.213911 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64ea2a51-6267-47be-ad85-71383a743190 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:21.214336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64ea2a51-6267-47be-ad85-71383a743190 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:21.214743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-64ea2a51-6267-47be-ad85-71383a743190 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:21.282795 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-64ea2a51-6267-47be-ad85-71383a743190 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:21.290956 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-64ea2a51-6267-47be-ad85-71383a743190 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1608 microversion: 2.1 time: 0.090901 Aug 26 18:28:21.291554 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 334/674] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:21 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1608 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:21.440188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3eaf60cb-cd07-485f-a547-1c2fec44bc08 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:21.440919 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3eaf60cb-cd07-485f-a547-1c2fec44bc08 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:21.451149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3eaf60cb-cd07-485f-a547-1c2fec44bc08 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:21.452037 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3eaf60cb-cd07-485f-a547-1c2fec44bc08 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:21.452919 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3eaf60cb-cd07-485f-a547-1c2fec44bc08 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:21.454264 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3eaf60cb-cd07-485f-a547-1c2fec44bc08 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:21.455169 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3eaf60cb-cd07-485f-a547-1c2fec44bc08 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:21.455912 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3eaf60cb-cd07-485f-a547-1c2fec44bc08 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:21.603268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3eaf60cb-cd07-485f-a547-1c2fec44bc08 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:21.611266 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3eaf60cb-cd07-485f-a547-1c2fec44bc08 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.175753 Aug 26 18:28:21.611839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 341/675] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:21 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:21.879367 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f3a3799a-e31e-47cf-b702-b498468a8153 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:21.879938 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f3a3799a-e31e-47cf-b702-b498468a8153 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:21.886192 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f3a3799a-e31e-47cf-b702-b498468a8153 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:21.886680 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f3a3799a-e31e-47cf-b702-b498468a8153 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:21.887109 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f3a3799a-e31e-47cf-b702-b498468a8153 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:21.887799 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f3a3799a-e31e-47cf-b702-b498468a8153 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:21.888255 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f3a3799a-e31e-47cf-b702-b498468a8153 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:21.888675 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f3a3799a-e31e-47cf-b702-b498468a8153 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:22.023123 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f3a3799a-e31e-47cf-b702-b498468a8153 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:22.031883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f3a3799a-e31e-47cf-b702-b498468a8153 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:22.033443 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f3a3799a-e31e-47cf-b702-b498468a8153 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:22.034608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f3a3799a-e31e-47cf-b702-b498468a8153 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1407 microversion: 2.20 time: 0.159461 Aug 26 18:28:22.035205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 335/676] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:21 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:22.312043 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9203f88e-341a-4d1e-9ff7-6ec28570ae11 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:22.312648 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9203f88e-341a-4d1e-9ff7-6ec28570ae11 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:22.319358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9203f88e-341a-4d1e-9ff7-6ec28570ae11 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:22.319850 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9203f88e-341a-4d1e-9ff7-6ec28570ae11 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:22.320287 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9203f88e-341a-4d1e-9ff7-6ec28570ae11 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:22.321036 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9203f88e-341a-4d1e-9ff7-6ec28570ae11 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:22.321473 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9203f88e-341a-4d1e-9ff7-6ec28570ae11 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:22.321894 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9203f88e-341a-4d1e-9ff7-6ec28570ae11 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:22.395496 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9203f88e-341a-4d1e-9ff7-6ec28570ae11 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:22.398479 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:22.407230 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9203f88e-341a-4d1e-9ff7-6ec28570ae11 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1608 microversion: 2.1 time: 0.098763 Aug 26 18:28:22.407845 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 342/677] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:22 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1608 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:22.633337 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1d739c6f-8067-41f9-a6e5-8a5efd1fd029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:22.634733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1d739c6f-8067-41f9-a6e5-8a5efd1fd029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:22.650248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d739c6f-8067-41f9-a6e5-8a5efd1fd029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:22.650915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d739c6f-8067-41f9-a6e5-8a5efd1fd029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:22.651345 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d739c6f-8067-41f9-a6e5-8a5efd1fd029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:22.652196 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d739c6f-8067-41f9-a6e5-8a5efd1fd029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:22.652655 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d739c6f-8067-41f9-a6e5-8a5efd1fd029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:22.653245 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d739c6f-8067-41f9-a6e5-8a5efd1fd029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:22.914718 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1d739c6f-8067-41f9-a6e5-8a5efd1fd029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:22.928200 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1d739c6f-8067-41f9-a6e5-8a5efd1fd029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.299608 Aug 26 18:28:22.937674 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 336/678] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:22 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:23.060063 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eab181f4-c9db-41a7-9768-14b54667ae0f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:23.060710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eab181f4-c9db-41a7-9768-14b54667ae0f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:23.073834 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eab181f4-c9db-41a7-9768-14b54667ae0f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:23.074976 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eab181f4-c9db-41a7-9768-14b54667ae0f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:23.074976 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eab181f4-c9db-41a7-9768-14b54667ae0f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:23.075510 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eab181f4-c9db-41a7-9768-14b54667ae0f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:23.076025 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eab181f4-c9db-41a7-9768-14b54667ae0f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:23.076446 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eab181f4-c9db-41a7-9768-14b54667ae0f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:23.197092 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=20 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:23.214201 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eab181f4-c9db-41a7-9768-14b54667ae0f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:23.222840 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eab181f4-c9db-41a7-9768-14b54667ae0f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:23.224244 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eab181f4-c9db-41a7-9768-14b54667ae0f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:23.225431 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eab181f4-c9db-41a7-9768-14b54667ae0f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1599 microversion: 2.20 time: 0.169749 Aug 26 18:28:23.225994 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 343/679] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:28:23 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:28:23.248671 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8993b09e-de09-42e9-b2d9-1d4f11a6fb2e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:23.249198 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8993b09e-de09-42e9-b2d9-1d4f11a6fb2e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:23.251998 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:23.252662 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=6 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:23.261257 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8993b09e-de09-42e9-b2d9-1d4f11a6fb2e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:23.261688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8993b09e-de09-42e9-b2d9-1d4f11a6fb2e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:23.262159 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8993b09e-de09-42e9-b2d9-1d4f11a6fb2e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:23.262856 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8993b09e-de09-42e9-b2d9-1d4f11a6fb2e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:23.263327 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8993b09e-de09-42e9-b2d9-1d4f11a6fb2e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:23.263749 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8993b09e-de09-42e9-b2d9-1d4f11a6fb2e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:23.299996 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b09206b2-0f19-4a4f-a683-05ac834e55be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:23.301539 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b09206b2-0f19-4a4f-a683-05ac834e55be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:23.307775 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b09206b2-0f19-4a4f-a683-05ac834e55be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:23.308265 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b09206b2-0f19-4a4f-a683-05ac834e55be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:23.308697 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b09206b2-0f19-4a4f-a683-05ac834e55be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:23.309440 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b09206b2-0f19-4a4f-a683-05ac834e55be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:23.309892 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b09206b2-0f19-4a4f-a683-05ac834e55be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:23.310321 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b09206b2-0f19-4a4f-a683-05ac834e55be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:23.354335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8993b09e-de09-42e9-b2d9-1d4f11a6fb2e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.108513 Aug 26 18:28:23.355871 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 337/680] 10.222.0.45 () {60 vars in 1316 bytes} [Fri Aug 26 18:28:23 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:28:23.404167 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-b09206b2-0f19-4a4f-a683-05ac834e55be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lazy-loading 'services' on Instance uuid 64b399c3-d3a3-4193-9826-e509b3b9b529 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:28:23.428954 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-fc0794e5-c925-4551-a6b9-2968953a3552 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:23.429667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-fc0794e5-c925-4551-a6b9-2968953a3552 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:23.436496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fc0794e5-c925-4551-a6b9-2968953a3552 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:23.437024 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fc0794e5-c925-4551-a6b9-2968953a3552 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:23.437457 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fc0794e5-c925-4551-a6b9-2968953a3552 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:23.438174 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fc0794e5-c925-4551-a6b9-2968953a3552 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:23.438702 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fc0794e5-c925-4551-a6b9-2968953a3552 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:23.439117 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fc0794e5-c925-4551-a6b9-2968953a3552 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:23.473505 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fc0794e5-c925-4551-a6b9-2968953a3552 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:23.473992 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fc0794e5-c925-4551-a6b9-2968953a3552 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:23.474431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fc0794e5-c925-4551-a6b9-2968953a3552 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:23.474920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-fc0794e5-c925-4551-a6b9-2968953a3552 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lazy-loading 'fault' on Instance uuid 024e8a0f-0670-4aec-8ec6-e8afbc67d464 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:28:23.487006 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b09206b2-0f19-4a4f-a683-05ac834e55be tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "DELETE /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments/fee8972f-344e-4b3f-a6b0-6312a3cc2ffb" status: 202 len: 0 microversion: 2.1 time: 0.189145 Aug 26 18:28:23.487917 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 344/681] 10.222.0.45 () {58 vars in 1416 bytes} [Fri Aug 26 18:28:23 2022] DELETE /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments/fee8972f-344e-4b3f-a6b0-6312a3cc2ffb => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:28:23.496754 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-05fb9229-489b-4a3a-a214-a8c82c1a7c9f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:23.499174 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-05fb9229-489b-4a3a-a214-a8c82c1a7c9f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:23.505868 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05fb9229-489b-4a3a-a214-a8c82c1a7c9f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:23.506367 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05fb9229-489b-4a3a-a214-a8c82c1a7c9f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:23.506800 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05fb9229-489b-4a3a-a214-a8c82c1a7c9f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:23.507511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05fb9229-489b-4a3a-a214-a8c82c1a7c9f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:23.507962 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05fb9229-489b-4a3a-a214-a8c82c1a7c9f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:23.508385 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05fb9229-489b-4a3a-a214-a8c82c1a7c9f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:23.523100 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-fc0794e5-c925-4551-a6b9-2968953a3552 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:23.531927 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-fc0794e5-c925-4551-a6b9-2968953a3552 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1328 microversion: 2.1 time: 0.107616 Aug 26 18:28:23.546189 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 338/682] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:23 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1328 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:28:23.564105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-05fb9229-489b-4a3a-a214-a8c82c1a7c9f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071600 Aug 26 18:28:23.568922 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 345/683] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:28:23 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:23.963157 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-971e9605-7399-41a6-8623-80af434a8beb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:23.963878 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-971e9605-7399-41a6-8623-80af434a8beb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:23.970840 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-971e9605-7399-41a6-8623-80af434a8beb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:23.971336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-971e9605-7399-41a6-8623-80af434a8beb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:23.971785 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-971e9605-7399-41a6-8623-80af434a8beb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:23.972505 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-971e9605-7399-41a6-8623-80af434a8beb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:23.973153 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-971e9605-7399-41a6-8623-80af434a8beb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:23.973576 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-971e9605-7399-41a6-8623-80af434a8beb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:24.108143 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-971e9605-7399-41a6-8623-80af434a8beb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:24.116637 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-971e9605-7399-41a6-8623-80af434a8beb tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.157521 Aug 26 18:28:24.117286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 339/684] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:23 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:24.403272 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-0d4b7a80-ac61-4446-b83f-87f567fcf794 req-39e73ef8-d610-4e27-921b-2639f7d005fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f82d25b8-bf09-48ca-9098-20bff440e163", "tag": "9120b3ad-b9e1-459d-b90c-56a0a48c2f3d"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:24.413549 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0d4b7a80-ac61-4446-b83f-87f567fcf794 req-39e73ef8-d610-4e27-921b-2639f7d005fe service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:24.414025 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0d4b7a80-ac61-4446-b83f-87f567fcf794 req-39e73ef8-d610-4e27-921b-2639f7d005fe service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:24.414442 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0d4b7a80-ac61-4446-b83f-87f567fcf794 req-39e73ef8-d610-4e27-921b-2639f7d005fe service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:24.426105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-0d4b7a80-ac61-4446-b83f-87f567fcf794 req-39e73ef8-d610-4e27-921b-2639f7d005fe service nova] Creating event network-changed:9120b3ad-b9e1-459d-b90c-56a0a48c2f3d for instance f82d25b8-bf09-48ca-9098-20bff440e163 on hv-cinder-85199 Aug 26 18:28:24.431137 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-0d4b7a80-ac61-4446-b83f-87f567fcf794 req-39e73ef8-d610-4e27-921b-2639f7d005fe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031811 Aug 26 18:28:24.431791 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 346/685] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:24.553983 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4b1f3322-94a5-46b7-9012-c31920b3681c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:24.554553 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4b1f3322-94a5-46b7-9012-c31920b3681c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:24.560942 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b1f3322-94a5-46b7-9012-c31920b3681c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:24.561391 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b1f3322-94a5-46b7-9012-c31920b3681c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:24.562003 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b1f3322-94a5-46b7-9012-c31920b3681c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:24.562693 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b1f3322-94a5-46b7-9012-c31920b3681c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:24.563147 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b1f3322-94a5-46b7-9012-c31920b3681c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:24.563663 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b1f3322-94a5-46b7-9012-c31920b3681c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:24.577649 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5cbf608a-379a-4d6a-8164-4fcdca75c4da tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:24.580521 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5cbf608a-379a-4d6a-8164-4fcdca75c4da tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:24.587578 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbf608a-379a-4d6a-8164-4fcdca75c4da tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:24.588178 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbf608a-379a-4d6a-8164-4fcdca75c4da tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:24.588683 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbf608a-379a-4d6a-8164-4fcdca75c4da tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:24.589657 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbf608a-379a-4d6a-8164-4fcdca75c4da tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:24.590291 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbf608a-379a-4d6a-8164-4fcdca75c4da tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:24.590782 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbf608a-379a-4d6a-8164-4fcdca75c4da tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:24.597795 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b1f3322-94a5-46b7-9012-c31920b3681c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:24.598431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b1f3322-94a5-46b7-9012-c31920b3681c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:24.598856 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b1f3322-94a5-46b7-9012-c31920b3681c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:24.599564 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-4b1f3322-94a5-46b7-9012-c31920b3681c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lazy-loading 'fault' on Instance uuid 024e8a0f-0670-4aec-8ec6-e8afbc67d464 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:28:24.624228 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5cbf608a-379a-4d6a-8164-4fcdca75c4da tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050945 Aug 26 18:28:24.624913 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 347/686] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:28:24 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:24.645898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-4b1f3322-94a5-46b7-9012-c31920b3681c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:24.649730 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:24.655387 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4b1f3322-94a5-46b7-9012-c31920b3681c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1328 microversion: 2.1 time: 0.105352 Aug 26 18:28:24.656070 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 340/687] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:24 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:25.138475 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2adc6662-e96a-414b-9ef5-f53aa07a5029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:25.139084 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2adc6662-e96a-414b-9ef5-f53aa07a5029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:25.145639 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2adc6662-e96a-414b-9ef5-f53aa07a5029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:25.146125 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2adc6662-e96a-414b-9ef5-f53aa07a5029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:25.146548 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2adc6662-e96a-414b-9ef5-f53aa07a5029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:25.147240 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2adc6662-e96a-414b-9ef5-f53aa07a5029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:25.147682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2adc6662-e96a-414b-9ef5-f53aa07a5029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:25.148095 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2adc6662-e96a-414b-9ef5-f53aa07a5029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:25.290149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2adc6662-e96a-414b-9ef5-f53aa07a5029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:25.300064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2adc6662-e96a-414b-9ef5-f53aa07a5029 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.165386 Aug 26 18:28:25.300852 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 348/688] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:25 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:25.637351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2d4963f2-494b-4097-9c54-b91e8c905848 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:25.639526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2d4963f2-494b-4097-9c54-b91e8c905848 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:25.646829 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d4963f2-494b-4097-9c54-b91e8c905848 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:25.647343 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d4963f2-494b-4097-9c54-b91e8c905848 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:25.647775 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d4963f2-494b-4097-9c54-b91e8c905848 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:25.648481 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d4963f2-494b-4097-9c54-b91e8c905848 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:25.648980 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d4963f2-494b-4097-9c54-b91e8c905848 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:25.649751 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d4963f2-494b-4097-9c54-b91e8c905848 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:25.676526 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ffb6870a-56fc-4992-a065-08f715b203b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:25.677176 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ffb6870a-56fc-4992-a065-08f715b203b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:25.681954 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2d4963f2-494b-4097-9c54-b91e8c905848 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048792 Aug 26 18:28:25.682554 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 341/689] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:28:25 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:25.684471 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb6870a-56fc-4992-a065-08f715b203b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:25.684998 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb6870a-56fc-4992-a065-08f715b203b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:25.685433 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb6870a-56fc-4992-a065-08f715b203b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:25.686157 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb6870a-56fc-4992-a065-08f715b203b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:25.686604 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb6870a-56fc-4992-a065-08f715b203b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:25.687025 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb6870a-56fc-4992-a065-08f715b203b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:25.719719 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb6870a-56fc-4992-a065-08f715b203b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:25.720196 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb6870a-56fc-4992-a065-08f715b203b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:25.720626 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb6870a-56fc-4992-a065-08f715b203b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:25.721122 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-ffb6870a-56fc-4992-a065-08f715b203b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lazy-loading 'fault' on Instance uuid 024e8a0f-0670-4aec-8ec6-e8afbc67d464 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:28:25.762841 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ffb6870a-56fc-4992-a065-08f715b203b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:25.771930 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ffb6870a-56fc-4992-a065-08f715b203b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1328 microversion: 2.1 time: 0.099390 Aug 26 18:28:25.772753 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 349/690] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:25 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:26.322022 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-b3215189-5149-44d8-a1ae-1e1447187925 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:26.322639 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-b3215189-5149-44d8-a1ae-1e1447187925 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:26.330028 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3215189-5149-44d8-a1ae-1e1447187925 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:26.330518 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3215189-5149-44d8-a1ae-1e1447187925 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:26.331023 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3215189-5149-44d8-a1ae-1e1447187925 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:26.331746 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3215189-5149-44d8-a1ae-1e1447187925 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:26.332244 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3215189-5149-44d8-a1ae-1e1447187925 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:26.332698 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b3215189-5149-44d8-a1ae-1e1447187925 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:26.467727 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b3215189-5149-44d8-a1ae-1e1447187925 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:26.475657 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-b3215189-5149-44d8-a1ae-1e1447187925 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.157597 Aug 26 18:28:26.476237 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 342/691] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:26 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:26.695534 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4d3e5e17-05f5-44c4-9cc3-9e4231b44fd1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:26.697791 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4d3e5e17-05f5-44c4-9cc3-9e4231b44fd1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:26.704199 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d3e5e17-05f5-44c4-9cc3-9e4231b44fd1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:26.704776 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d3e5e17-05f5-44c4-9cc3-9e4231b44fd1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:26.705212 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d3e5e17-05f5-44c4-9cc3-9e4231b44fd1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:26.705918 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d3e5e17-05f5-44c4-9cc3-9e4231b44fd1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:26.706364 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d3e5e17-05f5-44c4-9cc3-9e4231b44fd1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:26.706783 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d3e5e17-05f5-44c4-9cc3-9e4231b44fd1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:26.737268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4d3e5e17-05f5-44c4-9cc3-9e4231b44fd1 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045966 Aug 26 18:28:26.737739 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 350/692] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:28:26 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:26.795341 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-47bdcab5-a3aa-4461-ab91-46705d303f29 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:26.796621 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-47bdcab5-a3aa-4461-ab91-46705d303f29 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:26.803663 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-47bdcab5-a3aa-4461-ab91-46705d303f29 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:26.804153 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-47bdcab5-a3aa-4461-ab91-46705d303f29 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:26.804580 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-47bdcab5-a3aa-4461-ab91-46705d303f29 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:26.805324 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-47bdcab5-a3aa-4461-ab91-46705d303f29 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:26.805713 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-47bdcab5-a3aa-4461-ab91-46705d303f29 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:26.806147 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-47bdcab5-a3aa-4461-ab91-46705d303f29 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:26.840208 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-47bdcab5-a3aa-4461-ab91-46705d303f29 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:26.840691 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-47bdcab5-a3aa-4461-ab91-46705d303f29 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:26.841147 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-47bdcab5-a3aa-4461-ab91-46705d303f29 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:26.841592 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-47bdcab5-a3aa-4461-ab91-46705d303f29 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lazy-loading 'fault' on Instance uuid 024e8a0f-0670-4aec-8ec6-e8afbc67d464 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:28:26.883082 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-47bdcab5-a3aa-4461-ab91-46705d303f29 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:26.891457 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-47bdcab5-a3aa-4461-ab91-46705d303f29 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 200 len: 1328 microversion: 2.1 time: 0.100037 Aug 26 18:28:26.892047 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 343/693] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:26 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:27.498443 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-172473e0-9d43-46c6-8080-c1d84d7f0827 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:27.499255 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-172473e0-9d43-46c6-8080-c1d84d7f0827 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:27.508645 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-172473e0-9d43-46c6-8080-c1d84d7f0827 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:27.509174 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-172473e0-9d43-46c6-8080-c1d84d7f0827 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:27.509600 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-172473e0-9d43-46c6-8080-c1d84d7f0827 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:27.510468 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-172473e0-9d43-46c6-8080-c1d84d7f0827 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:27.511100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-172473e0-9d43-46c6-8080-c1d84d7f0827 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:27.511706 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-172473e0-9d43-46c6-8080-c1d84d7f0827 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:27.750798 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f7302c65-ed18-4655-8556-f4faa459ce86 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:27.756801 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f7302c65-ed18-4655-8556-f4faa459ce86 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:27.768265 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7302c65-ed18-4655-8556-f4faa459ce86 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:27.768782 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7302c65-ed18-4655-8556-f4faa459ce86 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:27.769224 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7302c65-ed18-4655-8556-f4faa459ce86 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:27.769933 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7302c65-ed18-4655-8556-f4faa459ce86 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:27.770382 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7302c65-ed18-4655-8556-f4faa459ce86 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:27.770801 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7302c65-ed18-4655-8556-f4faa459ce86 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:27.788676 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-172473e0-9d43-46c6-8080-c1d84d7f0827 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:27.801005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-172473e0-9d43-46c6-8080-c1d84d7f0827 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.308006 Aug 26 18:28:27.802612 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 351/694] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:27 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:27.825440 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f7302c65-ed18-4655-8556-f4faa459ce86 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078922 Aug 26 18:28:27.826381 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 344/695] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:28:27 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:28:27.912061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-161745fe-ad4d-453d-bdb0-669769425c1a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:27.912684 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-161745fe-ad4d-453d-bdb0-669769425c1a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:27.920775 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-161745fe-ad4d-453d-bdb0-669769425c1a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:27.921474 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-161745fe-ad4d-453d-bdb0-669769425c1a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:27.921965 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-161745fe-ad4d-453d-bdb0-669769425c1a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:27.922845 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-161745fe-ad4d-453d-bdb0-669769425c1a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:27.923342 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-161745fe-ad4d-453d-bdb0-669769425c1a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:27.923759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-161745fe-ad4d-453d-bdb0-669769425c1a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:27.939030 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-161745fe-ad4d-453d-bdb0-669769425c1a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] HTTP exception thrown: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-161745fe-ad4d-453d-bdb0-669769425c1a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Request method failure captured: Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 HTTP/1.1 Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ-wY72LHC3HbogcNq8IsRgSTdquEdc25Sd_AymXE_yPvTf3rJTQxS04xShW7S9PO9wZrSSqTaOR91AlrDoB7dQUozLOpOqPi045raet5Y7P0k_bJi8JCCndvP3WvGkowaXi1Os_FJ1SXihOBzlx9foNqfd6-IbV7Spl58jOB54xpPI Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: dd848c03af214b948ab01dee79cb7c34 Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:28:27.941759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:28:27.943297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dd848c03af214b948ab01dee79cb7c34", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dd848c03af214b948ab01dee79cb7c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dd848c03af214b948ab01dee79cb7c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dd848c03af214b948ab01dee79cb7c34"}]}] Aug 26 18:28:27.943297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:28:27.943297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: dd848c03af214b948ab01dee79cb7c34 Aug 26 18:28:27.943297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:28:27.943297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeTestJSON-1312245293-project Aug 26 18:28:27.943297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:28:27.943297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:28:27.943297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: 85158030e4904eab877dc5da3a6bbd33 Aug 26 18:28:27.943297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeTestJSON-1312245293-project Aug 26 18:28:27.943297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:28:27.943297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. Aug 26 18:28:27.943297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': '024e8a0f-0670-4aec-8ec6-e8afbc67d464'} Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:28:27.944061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. Aug 26 18:28:27.945769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:27.949463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-161745fe-ad4d-453d-bdb0-669769425c1a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Returning 404 to user: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:28:27.951151 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-161745fe-ad4d-453d-bdb0-669769425c1a tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 404 len: 111 microversion: 2.1 time: 0.042589 Aug 26 18:28:27.951711 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 352/696] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:27 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:28:27.960802 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8fcbb76f-a4f6-47cc-856b-2409e600a7b4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '.version_select at 0x7fc744238790>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:27.982912 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8fcbb76f-a4f6-47cc-856b-2409e600a7b4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918747375" status: 202 len: 0 microversion: 2.1 time: 0.025865 Aug 26 18:28:27.983859 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 345/697] 10.222.0.45 () {58 vars in 1221 bytes} [Fri Aug 26 18:28:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918747375 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:28:28.678050 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-145c2968-61a7-4fbc-bcf4-1f18d63d1156 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Action: 'create', calling method: .version_select at 0x7fc74410e1f0>, body: {"keypair": {"name": "tempest-keypair-1355319377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHBQFXQ6tQLcv8OJoJmmt2ARkBEmVmM/O6dASll9VZ7VuhU/B/56Cx6w35Qu2OHZlm7TiZeeMixmrtiMRnZkR+GW/7Dl2qtWV1D8U83poUxhhc5ebeRV4c0qNYW9AOnZg=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:28.695508 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-145c2968-61a7-4fbc-bcf4-1f18d63d1156 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Getting quotas for project dd848c03af214b948ab01dee79cb7c34. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:28:28.699522 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-145c2968-61a7-4fbc-bcf4-1f18d63d1156 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Getting quotas for user 85158030e4904eab877dc5da3a6bbd33 and project dd848c03af214b948ab01dee79cb7c34. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:28:28.724420 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-145c2968-61a7-4fbc-bcf4-1f18d63d1156 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050283 Aug 26 18:28:28.725490 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 353/698] 10.222.0.45 () {60 vars in 1159 bytes} [Fri Aug 26 18:28:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:28.824259 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9e795b12-b343-4945-a252-2995b4346b5e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:28.824999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9e795b12-b343-4945-a252-2995b4346b5e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:28.836004 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9e795b12-b343-4945-a252-2995b4346b5e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:28.836925 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9e795b12-b343-4945-a252-2995b4346b5e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:28.837722 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9e795b12-b343-4945-a252-2995b4346b5e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:28.838645 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ae6cb469-41a5-46bc-b627-aaf8350fd2e2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:28.839085 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9e795b12-b343-4945-a252-2995b4346b5e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:28.839808 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9e795b12-b343-4945-a252-2995b4346b5e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:28.840556 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9e795b12-b343-4945-a252-2995b4346b5e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:28.841145 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ae6cb469-41a5-46bc-b627-aaf8350fd2e2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:28.850194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6cb469-41a5-46bc-b627-aaf8350fd2e2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:28.850879 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6cb469-41a5-46bc-b627-aaf8350fd2e2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:28.851244 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6cb469-41a5-46bc-b627-aaf8350fd2e2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:28.852135 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6cb469-41a5-46bc-b627-aaf8350fd2e2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:28.852663 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6cb469-41a5-46bc-b627-aaf8350fd2e2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:28.853321 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6cb469-41a5-46bc-b627-aaf8350fd2e2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:28.901084 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ae6cb469-41a5-46bc-b627-aaf8350fd2e2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057389 Aug 26 18:28:28.901084 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 354/699] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:28:28 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 18:28:28.982414 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-73849c31-54d9-4328-86b7-da450ca39a61 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:28.982923 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-73849c31-54d9-4328-86b7-da450ca39a61 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:28.985145 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:28.992974 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73849c31-54d9-4328-86b7-da450ca39a61 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:28.993465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73849c31-54d9-4328-86b7-da450ca39a61 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:28.993929 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73849c31-54d9-4328-86b7-da450ca39a61 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:28.994913 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73849c31-54d9-4328-86b7-da450ca39a61 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:28.995542 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73849c31-54d9-4328-86b7-da450ca39a61 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:28.995939 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73849c31-54d9-4328-86b7-da450ca39a61 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:29.010033 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9e795b12-b343-4945-a252-2995b4346b5e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:29.021104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9e795b12-b343-4945-a252-2995b4346b5e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.200244 Aug 26 18:28:29.021939 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 346/700] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:28 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:29.041633 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-73849c31-54d9-4328-86b7-da450ca39a61 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:28:29.168996 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-73849c31-54d9-4328-86b7-da450ca39a61 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "DELETE /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 204 len: 0 microversion: 2.1 time: 0.190896 Aug 26 18:28:29.170027 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 355/701] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:28:28 2022] DELETE /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:28:29.179222 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-333138f5-ed46-40ea-99b2-2c5bff5fbd66 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:29.180264 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-333138f5-ed46-40ea-99b2-2c5bff5fbd66 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:29.188180 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-333138f5-ed46-40ea-99b2-2c5bff5fbd66 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:29.189051 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-333138f5-ed46-40ea-99b2-2c5bff5fbd66 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:29.189618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-333138f5-ed46-40ea-99b2-2c5bff5fbd66 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:29.190529 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-333138f5-ed46-40ea-99b2-2c5bff5fbd66 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:29.191177 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-333138f5-ed46-40ea-99b2-2c5bff5fbd66 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:29.191578 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-333138f5-ed46-40ea-99b2-2c5bff5fbd66 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:29.647518 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-333138f5-ed46-40ea-99b2-2c5bff5fbd66 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:29.656437 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-333138f5-ed46-40ea-99b2-2c5bff5fbd66 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1691 microversion: 2.1 time: 0.481702 Aug 26 18:28:29.657077 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 347/702] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:29 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1691 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:30.044671 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e89d75c1-69ec-44c4-bf31-f0cf5c6ecebf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:30.045574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e89d75c1-69ec-44c4-bf31-f0cf5c6ecebf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:30.053509 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e89d75c1-69ec-44c4-bf31-f0cf5c6ecebf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:30.054190 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e89d75c1-69ec-44c4-bf31-f0cf5c6ecebf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:30.054635 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e89d75c1-69ec-44c4-bf31-f0cf5c6ecebf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:30.055357 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e89d75c1-69ec-44c4-bf31-f0cf5c6ecebf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:30.056089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e89d75c1-69ec-44c4-bf31-f0cf5c6ecebf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:30.056748 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e89d75c1-69ec-44c4-bf31-f0cf5c6ecebf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:30.205523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e89d75c1-69ec-44c4-bf31-f0cf5c6ecebf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:30.212511 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-710447651", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4dcd9f1b-d41d-4f89-929b-818235bdfa4c"}], "security_groups": [{"name": "tempest-securitygroup--936714481"}], "key_name": "tempest-keypair-1355319377", "user_data": "}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:30.213938 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e89d75c1-69ec-44c4-bf31-f0cf5c6ecebf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.174563 Aug 26 18:28:30.214527 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 356/703] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:30 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:30.332453 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.network.neutron [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] validate_networks() for [('4dcd9f1b-d41d-4f89-929b-818235bdfa4c', None, None, None, None, None)] {{(pid=120540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:28:30.679141 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c2021f7d-cb45-45c6-a7f9-af759ebf1908 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:30.679843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c2021f7d-cb45-45c6-a7f9-af759ebf1908 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:30.686430 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2021f7d-cb45-45c6-a7f9-af759ebf1908 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:30.687205 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2021f7d-cb45-45c6-a7f9-af759ebf1908 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:30.687623 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2021f7d-cb45-45c6-a7f9-af759ebf1908 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:30.688795 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2021f7d-cb45-45c6-a7f9-af759ebf1908 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:30.689259 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2021f7d-cb45-45c6-a7f9-af759ebf1908 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:30.689881 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2021f7d-cb45-45c6-a7f9-af759ebf1908 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:30.721643 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Flavor limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:28:30.722169 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Image limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:28:30.722768 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Flavor pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:28:30.723274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Image pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:28:30.723783 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:28:30.734017 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:30.735011 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:30.735645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:30.736909 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:30.737467 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:30.737989 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:30.757248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Getting quotas for project dd848c03af214b948ab01dee79cb7c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:28:30.761495 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Getting quotas for user 85158030e4904eab877dc5da3a6bbd33 and project dd848c03af214b948ab01dee79cb7c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:28:30.772996 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Going to run 1 instances... {{(pid=120540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:28:30.775622 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:28:30.825436 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-bb4885e3-97cb-4cd9-89ce-afa026cf0639 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.618141 Aug 26 18:28:30.825713 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c2021f7d-cb45-45c6-a7f9-af759ebf1908 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:30.826281 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 348/704] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:28:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 18:28:30.831295 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-254b7204-1ab0-4bf6-959a-ebc5032ceb7c req-a8ada268-d2ee-4602-8854-c3da7d1f0d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbde000-0844-4305-9309-31a6e53167a7", "name": "network-vif-plugged", "status": "completed", "tag": "be9a00ea-a696-4aaa-be11-b5198ea1bb36"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:30.841716 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-254b7204-1ab0-4bf6-959a-ebc5032ceb7c req-a8ada268-d2ee-4602-8854-c3da7d1f0d11 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:30.842191 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-254b7204-1ab0-4bf6-959a-ebc5032ceb7c req-a8ada268-d2ee-4602-8854-c3da7d1f0d11 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:30.842631 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-254b7204-1ab0-4bf6-959a-ebc5032ceb7c req-a8ada268-d2ee-4602-8854-c3da7d1f0d11 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:30.844430 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c2021f7d-cb45-45c6-a7f9-af759ebf1908 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1691 microversion: 2.1 time: 0.170178 Aug 26 18:28:30.845598 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 357/705] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:30 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:30.851637 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a0969943-2b71-45f9-a2aa-c7af28b5ead8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:30.852355 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a0969943-2b71-45f9-a2aa-c7af28b5ead8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:30.866377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-254b7204-1ab0-4bf6-959a-ebc5032ceb7c req-a8ada268-d2ee-4602-8854-c3da7d1f0d11 service nova] Creating event network-vif-plugged:be9a00ea-a696-4aaa-be11-b5198ea1bb36 for instance 4cbde000-0844-4305-9309-31a6e53167a7 on hv-cinder-85199 Aug 26 18:28:30.871746 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-254b7204-1ab0-4bf6-959a-ebc5032ceb7c req-a8ada268-d2ee-4602-8854-c3da7d1f0d11 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044477 Aug 26 18:28:30.872376 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 349/706] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:30.912062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a0969943-2b71-45f9-a2aa-c7af28b5ead8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:30.919497 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a0969943-2b71-45f9-a2aa-c7af28b5ead8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1237 microversion: 2.1 time: 0.071759 Aug 26 18:28:30.920112 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 358/707] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:30 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:31.237809 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e0f10b1f-ad4a-4b16-9574-72acc15a19c8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:31.238574 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e0f10b1f-ad4a-4b16-9574-72acc15a19c8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:31.246227 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e0f10b1f-ad4a-4b16-9574-72acc15a19c8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:31.246767 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e0f10b1f-ad4a-4b16-9574-72acc15a19c8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:31.247253 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e0f10b1f-ad4a-4b16-9574-72acc15a19c8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:31.247945 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e0f10b1f-ad4a-4b16-9574-72acc15a19c8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:31.248386 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e0f10b1f-ad4a-4b16-9574-72acc15a19c8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:31.248827 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e0f10b1f-ad4a-4b16-9574-72acc15a19c8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:31.259661 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bee27567-d163-4dc4-b314-0f5efee65561 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:31.260202 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bee27567-d163-4dc4-b314-0f5efee65561 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:31.268136 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bee27567-d163-4dc4-b314-0f5efee65561 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:31.268664 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bee27567-d163-4dc4-b314-0f5efee65561 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:31.269132 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bee27567-d163-4dc4-b314-0f5efee65561 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:31.269842 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bee27567-d163-4dc4-b314-0f5efee65561 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:31.270292 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bee27567-d163-4dc4-b314-0f5efee65561 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:31.270726 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bee27567-d163-4dc4-b314-0f5efee65561 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:31.357388 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-bee27567-d163-4dc4-b314-0f5efee65561 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lazy-loading 'services' on Instance uuid 5b0208ae-2692-4fda-adb6-946c6cec83ae {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:28:31.359795 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:31.396109 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e0f10b1f-ad4a-4b16-9574-72acc15a19c8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:31.404989 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e0f10b1f-ad4a-4b16-9574-72acc15a19c8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.172887 Aug 26 18:28:31.405586 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 350/708] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:31 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:31.440765 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bee27567-d163-4dc4-b314-0f5efee65561 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae/os-volume_attachments/61a03932-0dd3-49bb-b595-058ffd362c9c" status: 202 len: 0 microversion: 2.1 time: 0.184796 Aug 26 18:28:31.441581 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 359/709] 10.222.0.45 () {58 vars in 1416 bytes} [Fri Aug 26 18:28:31 2022] DELETE /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae/os-volume_attachments/61a03932-0dd3-49bb-b595-058ffd362c9c => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:28:31.871781 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-051105b4-3514-4eee-902e-1ce7cb5bcb70 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:31.872848 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-051105b4-3514-4eee-902e-1ce7cb5bcb70 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:31.882728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-051105b4-3514-4eee-902e-1ce7cb5bcb70 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:31.883592 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-051105b4-3514-4eee-902e-1ce7cb5bcb70 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:31.884296 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-051105b4-3514-4eee-902e-1ce7cb5bcb70 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:31.885474 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-051105b4-3514-4eee-902e-1ce7cb5bcb70 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:31.886205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-051105b4-3514-4eee-902e-1ce7cb5bcb70 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:31.886892 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-051105b4-3514-4eee-902e-1ce7cb5bcb70 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:31.940158 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-de4bedba-5f1a-4571-87c9-ef3e9ba880b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:31.940881 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-de4bedba-5f1a-4571-87c9-ef3e9ba880b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:31.947273 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de4bedba-5f1a-4571-87c9-ef3e9ba880b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:31.947762 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de4bedba-5f1a-4571-87c9-ef3e9ba880b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:31.948195 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de4bedba-5f1a-4571-87c9-ef3e9ba880b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:31.948929 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de4bedba-5f1a-4571-87c9-ef3e9ba880b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:31.949382 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de4bedba-5f1a-4571-87c9-ef3e9ba880b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:31.949806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de4bedba-5f1a-4571-87c9-ef3e9ba880b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:32.012019 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-de4bedba-5f1a-4571-87c9-ef3e9ba880b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:32.019964 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-de4bedba-5f1a-4571-87c9-ef3e9ba880b5 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1241 microversion: 2.1 time: 0.084102 Aug 26 18:28:32.020545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 360/710] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:31 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:32.022580 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-051105b4-3514-4eee-902e-1ce7cb5bcb70 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:32.030968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-051105b4-3514-4eee-902e-1ce7cb5bcb70 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1691 microversion: 2.1 time: 0.165817 Aug 26 18:28:32.031533 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 351/711] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:31 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:32.427570 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4cd8c1d5-3172-41ba-8db8-58d8fe3c3631 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:32.428234 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4cd8c1d5-3172-41ba-8db8-58d8fe3c3631 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:32.434799 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cd8c1d5-3172-41ba-8db8-58d8fe3c3631 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:32.435284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cd8c1d5-3172-41ba-8db8-58d8fe3c3631 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:32.435717 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cd8c1d5-3172-41ba-8db8-58d8fe3c3631 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:32.436391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cd8c1d5-3172-41ba-8db8-58d8fe3c3631 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:32.436873 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cd8c1d5-3172-41ba-8db8-58d8fe3c3631 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:32.437287 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cd8c1d5-3172-41ba-8db8-58d8fe3c3631 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:32.572841 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4cd8c1d5-3172-41ba-8db8-58d8fe3c3631 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:32.581100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4cd8c1d5-3172-41ba-8db8-58d8fe3c3631 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.157509 Aug 26 18:28:32.581700 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 361/712] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:32 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:33.041168 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-759c933b-f777-4adb-b371-65782b4f1520 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:33.041765 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-759c933b-f777-4adb-b371-65782b4f1520 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:33.049475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-759c933b-f777-4adb-b371-65782b4f1520 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:33.049969 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-759c933b-f777-4adb-b371-65782b4f1520 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:33.050403 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-759c933b-f777-4adb-b371-65782b4f1520 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:33.051114 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-759c933b-f777-4adb-b371-65782b4f1520 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:33.051571 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-759c933b-f777-4adb-b371-65782b4f1520 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:33.051990 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-759c933b-f777-4adb-b371-65782b4f1520 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:33.053374 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e6f59f68-fc44-4532-bc5b-d263ceb1fd5c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:33.054043 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e6f59f68-fc44-4532-bc5b-d263ceb1fd5c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:33.061755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6f59f68-fc44-4532-bc5b-d263ceb1fd5c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:33.062642 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6f59f68-fc44-4532-bc5b-d263ceb1fd5c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:33.063378 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6f59f68-fc44-4532-bc5b-d263ceb1fd5c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:33.064333 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6f59f68-fc44-4532-bc5b-d263ceb1fd5c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:33.064817 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6f59f68-fc44-4532-bc5b-d263ceb1fd5c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:33.065239 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6f59f68-fc44-4532-bc5b-d263ceb1fd5c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:33.120525 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-759c933b-f777-4adb-b371-65782b4f1520 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:33.127111 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-759c933b-f777-4adb-b371-65782b4f1520 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1233 microversion: 2.1 time: 0.089954 Aug 26 18:28:33.128020 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 352/713] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:33 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1233 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:33.209073 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e6f59f68-fc44-4532-bc5b-d263ceb1fd5c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:33.218126 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e6f59f68-fc44-4532-bc5b-d263ceb1fd5c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1691 microversion: 2.1 time: 0.169742 Aug 26 18:28:33.218708 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 362/714] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:33 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:33.604658 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8877916c-505c-4b59-b7c4-66a4624d6448 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:33.605314 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8877916c-505c-4b59-b7c4-66a4624d6448 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:33.611688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8877916c-505c-4b59-b7c4-66a4624d6448 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:33.612189 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8877916c-505c-4b59-b7c4-66a4624d6448 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:33.612604 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8877916c-505c-4b59-b7c4-66a4624d6448 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:33.613323 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8877916c-505c-4b59-b7c4-66a4624d6448 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:33.613752 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8877916c-505c-4b59-b7c4-66a4624d6448 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:33.614179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8877916c-505c-4b59-b7c4-66a4624d6448 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:33.758774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8877916c-505c-4b59-b7c4-66a4624d6448 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:33.773252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8877916c-505c-4b59-b7c4-66a4624d6448 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.173847 Aug 26 18:28:33.773841 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 353/715] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:33 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:34.148650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2377d674-84a7-4536-93e9-66773bfbbdc6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:34.149292 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2377d674-84a7-4536-93e9-66773bfbbdc6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:34.156685 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2377d674-84a7-4536-93e9-66773bfbbdc6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:34.157320 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2377d674-84a7-4536-93e9-66773bfbbdc6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:34.157979 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2377d674-84a7-4536-93e9-66773bfbbdc6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:34.159132 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2377d674-84a7-4536-93e9-66773bfbbdc6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:34.159879 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2377d674-84a7-4536-93e9-66773bfbbdc6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:34.160604 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2377d674-84a7-4536-93e9-66773bfbbdc6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:34.227706 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2377d674-84a7-4536-93e9-66773bfbbdc6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:34.239605 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2377d674-84a7-4536-93e9-66773bfbbdc6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1289 microversion: 2.1 time: 0.094831 Aug 26 18:28:34.240492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 363/716] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:34 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:34.245644 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f2459f9a-cb0d-4a72-a109-b3419a98513b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:34.246275 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f2459f9a-cb0d-4a72-a109-b3419a98513b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:34.254494 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f2459f9a-cb0d-4a72-a109-b3419a98513b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:34.255513 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f2459f9a-cb0d-4a72-a109-b3419a98513b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:34.256142 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f2459f9a-cb0d-4a72-a109-b3419a98513b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:34.257115 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f2459f9a-cb0d-4a72-a109-b3419a98513b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:34.257960 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f2459f9a-cb0d-4a72-a109-b3419a98513b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:34.258773 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f2459f9a-cb0d-4a72-a109-b3419a98513b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:34.482856 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f2459f9a-cb0d-4a72-a109-b3419a98513b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:34.491586 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f2459f9a-cb0d-4a72-a109-b3419a98513b tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1691 microversion: 2.1 time: 0.255670 Aug 26 18:28:34.492296 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 354/717] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:34 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1691 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:28:34.695497 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-116e3728-4447-4f88-9b0e-732f6dfcacb4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:34.696117 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-116e3728-4447-4f88-9b0e-732f6dfcacb4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:34.702490 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-116e3728-4447-4f88-9b0e-732f6dfcacb4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:34.702988 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-116e3728-4447-4f88-9b0e-732f6dfcacb4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:34.703420 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-116e3728-4447-4f88-9b0e-732f6dfcacb4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:34.704125 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-116e3728-4447-4f88-9b0e-732f6dfcacb4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:34.704930 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-116e3728-4447-4f88-9b0e-732f6dfcacb4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:34.705591 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-116e3728-4447-4f88-9b0e-732f6dfcacb4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:34.733621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-116e3728-4447-4f88-9b0e-732f6dfcacb4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:28:34.796330 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-54f3d095-6cc5-4641-afb7-0a10db2b05ef tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:34.797251 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-54f3d095-6cc5-4641-afb7-0a10db2b05ef tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:34.819283 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-54f3d095-6cc5-4641-afb7-0a10db2b05ef tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:34.823623 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-54f3d095-6cc5-4641-afb7-0a10db2b05ef tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:34.825231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-54f3d095-6cc5-4641-afb7-0a10db2b05ef tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:34.830353 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-54f3d095-6cc5-4641-afb7-0a10db2b05ef tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:34.831585 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-54f3d095-6cc5-4641-afb7-0a10db2b05ef tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:34.832597 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-54f3d095-6cc5-4641-afb7-0a10db2b05ef tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:34.854922 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-116e3728-4447-4f88-9b0e-732f6dfcacb4 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 204 len: 0 microversion: 2.1 time: 0.163265 Aug 26 18:28:34.855511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 364/718] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:28:34 2022] DELETE /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 18:28:34.864505 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6cfdd948-f3f2-4213-b05c-dda74b051cff tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:34.865970 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6cfdd948-f3f2-4213-b05c-dda74b051cff tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:34.891464 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cfdd948-f3f2-4213-b05c-dda74b051cff tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:34.891982 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cfdd948-f3f2-4213-b05c-dda74b051cff tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:34.892380 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cfdd948-f3f2-4213-b05c-dda74b051cff tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:34.894682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cfdd948-f3f2-4213-b05c-dda74b051cff tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:34.895570 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cfdd948-f3f2-4213-b05c-dda74b051cff tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:34.896005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cfdd948-f3f2-4213-b05c-dda74b051cff tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:35.065016 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6cfdd948-f3f2-4213-b05c-dda74b051cff tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:35.074438 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6cfdd948-f3f2-4213-b05c-dda74b051cff tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1514 microversion: 2.1 time: 0.214152 Aug 26 18:28:35.075789 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 365/719] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:34 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1514 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:28:35.100115 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-54f3d095-6cc5-4641-afb7-0a10db2b05ef tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:35.109892 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-54f3d095-6cc5-4641-afb7-0a10db2b05ef tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1367 microversion: 2.1 time: 0.317652 Aug 26 18:28:35.110508 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 355/720] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:34 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:35.267663 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-26bde012-ad1d-489b-a6fb-a7c9a4519435 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:35.268964 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-26bde012-ad1d-489b-a6fb-a7c9a4519435 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:35.278487 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26bde012-ad1d-489b-a6fb-a7c9a4519435 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:35.279165 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26bde012-ad1d-489b-a6fb-a7c9a4519435 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:35.279678 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26bde012-ad1d-489b-a6fb-a7c9a4519435 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:35.280763 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26bde012-ad1d-489b-a6fb-a7c9a4519435 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:35.281297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26bde012-ad1d-489b-a6fb-a7c9a4519435 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:35.282028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26bde012-ad1d-489b-a6fb-a7c9a4519435 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:35.285894 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-ad404d8d-e719-4ac9-9022-ab9fbb51bb18 req-b6c753e0-0046-4d72-9a0a-e80715c30459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64b399c3-d3a3-4193-9826-e509b3b9b529", "name": "network-vif-deleted", "tag": "b0c5500f-b975-4591-a361-36f0917bc440"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:35.298172 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ad404d8d-e719-4ac9-9022-ab9fbb51bb18 req-b6c753e0-0046-4d72-9a0a-e80715c30459 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:35.298845 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ad404d8d-e719-4ac9-9022-ab9fbb51bb18 req-b6c753e0-0046-4d72-9a0a-e80715c30459 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:35.299480 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ad404d8d-e719-4ac9-9022-ab9fbb51bb18 req-b6c753e0-0046-4d72-9a0a-e80715c30459 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:35.312242 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-ad404d8d-e719-4ac9-9022-ab9fbb51bb18 req-b6c753e0-0046-4d72-9a0a-e80715c30459 service nova] Creating event network-vif-deleted:b0c5500f-b975-4591-a361-36f0917bc440 for instance 64b399c3-d3a3-4193-9826-e509b3b9b529 on hv-cinder-85199 Aug 26 18:28:35.318094 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-ad404d8d-e719-4ac9-9022-ab9fbb51bb18 req-b6c753e0-0046-4d72-9a0a-e80715c30459 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036020 Aug 26 18:28:35.319410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 356/721] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:35.367383 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26bde012-ad1d-489b-a6fb-a7c9a4519435 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:35.376019 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-26bde012-ad1d-489b-a6fb-a7c9a4519435 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1297 microversion: 2.1 time: 0.116107 Aug 26 18:28:35.376788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 366/722] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:35 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1297 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:35.516345 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4a59eafe-45d5-497d-b565-d24f3531cc18 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:35.517016 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4a59eafe-45d5-497d-b565-d24f3531cc18 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:35.525665 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4a59eafe-45d5-497d-b565-d24f3531cc18 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:35.526534 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4a59eafe-45d5-497d-b565-d24f3531cc18 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:35.527125 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4a59eafe-45d5-497d-b565-d24f3531cc18 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:35.527850 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4a59eafe-45d5-497d-b565-d24f3531cc18 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:35.530190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4a59eafe-45d5-497d-b565-d24f3531cc18 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:35.531037 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4a59eafe-45d5-497d-b565-d24f3531cc18 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:35.602441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-4a59eafe-45d5-497d-b565-d24f3531cc18 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:35.610626 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4a59eafe-45d5-497d-b565-d24f3531cc18 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1623 microversion: 2.1 time: 0.099261 Aug 26 18:28:35.611311 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 357/723] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:35 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1623 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:36.099612 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f7f1cbfc-8e62-4d58-920c-85be264dbe17 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:36.100219 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f7f1cbfc-8e62-4d58-920c-85be264dbe17 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:36.106752 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7f1cbfc-8e62-4d58-920c-85be264dbe17 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:36.107228 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7f1cbfc-8e62-4d58-920c-85be264dbe17 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:36.107627 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7f1cbfc-8e62-4d58-920c-85be264dbe17 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:36.108352 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7f1cbfc-8e62-4d58-920c-85be264dbe17 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:36.108821 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7f1cbfc-8e62-4d58-920c-85be264dbe17 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:36.109220 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7f1cbfc-8e62-4d58-920c-85be264dbe17 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:36.137883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8aed1f54-d125-450e-9dff-528fd29b7ef7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:36.138494 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8aed1f54-d125-450e-9dff-528fd29b7ef7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:36.140697 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:36.147129 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8aed1f54-d125-450e-9dff-528fd29b7ef7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:36.147822 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8aed1f54-d125-450e-9dff-528fd29b7ef7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:36.148269 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8aed1f54-d125-450e-9dff-528fd29b7ef7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:36.149003 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8aed1f54-d125-450e-9dff-528fd29b7ef7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:36.149625 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8aed1f54-d125-450e-9dff-528fd29b7ef7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:36.150376 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8aed1f54-d125-450e-9dff-528fd29b7ef7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:36.276346 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f7f1cbfc-8e62-4d58-920c-85be264dbe17 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:36.289857 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f7f1cbfc-8e62-4d58-920c-85be264dbe17 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1514 microversion: 2.1 time: 0.193968 Aug 26 18:28:36.290576 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 367/724] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:36 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:36.299372 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8aed1f54-d125-450e-9dff-528fd29b7ef7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:36.308516 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8aed1f54-d125-450e-9dff-528fd29b7ef7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1557 microversion: 2.1 time: 0.174778 Aug 26 18:28:36.309197 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 358/725] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:36 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:36.329223 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a816bd7f-6c24-491c-9329-2df76aa73de7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:36.329755 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a816bd7f-6c24-491c-9329-2df76aa73de7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:36.336445 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a816bd7f-6c24-491c-9329-2df76aa73de7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:36.336973 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a816bd7f-6c24-491c-9329-2df76aa73de7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:36.337394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a816bd7f-6c24-491c-9329-2df76aa73de7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:36.338097 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a816bd7f-6c24-491c-9329-2df76aa73de7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:36.338552 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a816bd7f-6c24-491c-9329-2df76aa73de7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:36.338970 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a816bd7f-6c24-491c-9329-2df76aa73de7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:36.396996 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-93e98877-ea41-4cc6-a2e3-9d1ddd6488f9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:36.397614 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-93e98877-ea41-4cc6-a2e3-9d1ddd6488f9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:36.404478 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e98877-ea41-4cc6-a2e3-9d1ddd6488f9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:36.405051 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e98877-ea41-4cc6-a2e3-9d1ddd6488f9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:36.405456 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e98877-ea41-4cc6-a2e3-9d1ddd6488f9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:36.406356 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e98877-ea41-4cc6-a2e3-9d1ddd6488f9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:36.406819 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e98877-ea41-4cc6-a2e3-9d1ddd6488f9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:36.407215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-93e98877-ea41-4cc6-a2e3-9d1ddd6488f9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:36.427287 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a816bd7f-6c24-491c-9329-2df76aa73de7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102036 Aug 26 18:28:36.428211 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 368/726] 10.222.0.45 () {58 vars in 1275 bytes} [Fri Aug 26 18:28:36 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:36.549665 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-93e98877-ea41-4cc6-a2e3-9d1ddd6488f9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:36.559296 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-93e98877-ea41-4cc6-a2e3-9d1ddd6488f9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1297 microversion: 2.1 time: 0.166082 Aug 26 18:28:36.563568 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 359/727] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:36 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1297 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:36.632133 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d4931c95-5b97-4a47-b644-1a11de3ca9f2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:36.632901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d4931c95-5b97-4a47-b644-1a11de3ca9f2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:36.640866 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4931c95-5b97-4a47-b644-1a11de3ca9f2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:36.641518 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4931c95-5b97-4a47-b644-1a11de3ca9f2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:36.641812 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4931c95-5b97-4a47-b644-1a11de3ca9f2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:36.642731 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4931c95-5b97-4a47-b644-1a11de3ca9f2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:36.643187 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4931c95-5b97-4a47-b644-1a11de3ca9f2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:36.647348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4931c95-5b97-4a47-b644-1a11de3ca9f2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:36.721421 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d4931c95-5b97-4a47-b644-1a11de3ca9f2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:36.730295 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d4931c95-5b97-4a47-b644-1a11de3ca9f2 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1623 microversion: 2.1 time: 0.102517 Aug 26 18:28:36.730900 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 369/728] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:36 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1623 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:37.311798 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ba55d443-315f-4f69-94af-a78d8f6bf1f1 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:37.312404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ba55d443-315f-4f69-94af-a78d8f6bf1f1 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:37.319288 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ba55d443-315f-4f69-94af-a78d8f6bf1f1 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:37.319779 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ba55d443-315f-4f69-94af-a78d8f6bf1f1 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:37.320207 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ba55d443-315f-4f69-94af-a78d8f6bf1f1 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:37.320936 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ba55d443-315f-4f69-94af-a78d8f6bf1f1 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:37.321377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ba55d443-315f-4f69-94af-a78d8f6bf1f1 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:37.321797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ba55d443-315f-4f69-94af-a78d8f6bf1f1 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:37.326161 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=100 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:37.581556 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b866b315-a4ca-4835-b04a-171c91b530bd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:37.582454 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b866b315-a4ca-4835-b04a-171c91b530bd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:37.590781 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b866b315-a4ca-4835-b04a-171c91b530bd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:37.591897 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b866b315-a4ca-4835-b04a-171c91b530bd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:37.592442 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b866b315-a4ca-4835-b04a-171c91b530bd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:37.593371 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b866b315-a4ca-4835-b04a-171c91b530bd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:37.593939 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b866b315-a4ca-4835-b04a-171c91b530bd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:37.594414 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b866b315-a4ca-4835-b04a-171c91b530bd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:37.679916 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b866b315-a4ca-4835-b04a-171c91b530bd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:37.688402 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b866b315-a4ca-4835-b04a-171c91b530bd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1295 microversion: 2.1 time: 0.111898 Aug 26 18:28:37.689889 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 370/729] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:37 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1295 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:28:37.754073 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bdb914e1-be47-4198-af78-2f9a6e773ba6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:37.754850 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bdb914e1-be47-4198-af78-2f9a6e773ba6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:37.764679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb914e1-be47-4198-af78-2f9a6e773ba6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:37.764679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb914e1-be47-4198-af78-2f9a6e773ba6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:37.764679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb914e1-be47-4198-af78-2f9a6e773ba6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:37.764679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb914e1-be47-4198-af78-2f9a6e773ba6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:37.765009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb914e1-be47-4198-af78-2f9a6e773ba6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:37.765009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb914e1-be47-4198-af78-2f9a6e773ba6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:37.801086 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb914e1-be47-4198-af78-2f9a6e773ba6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:37.801900 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb914e1-be47-4198-af78-2f9a6e773ba6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:37.802596 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb914e1-be47-4198-af78-2f9a6e773ba6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:37.803106 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-bdb914e1-be47-4198-af78-2f9a6e773ba6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lazy-loading 'fault' on Instance uuid 64b399c3-d3a3-4193-9826-e509b3b9b529 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:28:37.852517 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bdb914e1-be47-4198-af78-2f9a6e773ba6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:37.860679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bdb914e1-be47-4198-af78-2f9a6e773ba6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 200 len: 1336 microversion: 2.1 time: 0.111279 Aug 26 18:28:37.861582 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 371/730] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:37 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 1336 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:37.984081 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ba55d443-315f-4f69-94af-a78d8f6bf1f1 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:37.992651 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ba55d443-315f-4f69-94af-a78d8f6bf1f1 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1514 microversion: 2.1 time: 0.684817 Aug 26 18:28:37.993271 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 360/731] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:37 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1514 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:38.306677 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-1cd2fe8b-7daf-4575-9221-dd3e58c2ef64 req-9e521e52-7eaa-4975-8bfa-11af23cbf0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbde000-0844-4305-9309-31a6e53167a7", "tag": "be9a00ea-a696-4aaa-be11-b5198ea1bb36"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:38.318607 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1cd2fe8b-7daf-4575-9221-dd3e58c2ef64 req-9e521e52-7eaa-4975-8bfa-11af23cbf0f7 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:38.319465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1cd2fe8b-7daf-4575-9221-dd3e58c2ef64 req-9e521e52-7eaa-4975-8bfa-11af23cbf0f7 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:38.320276 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1cd2fe8b-7daf-4575-9221-dd3e58c2ef64 req-9e521e52-7eaa-4975-8bfa-11af23cbf0f7 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:38.336498 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-1cd2fe8b-7daf-4575-9221-dd3e58c2ef64 req-9e521e52-7eaa-4975-8bfa-11af23cbf0f7 service nova] Creating event network-changed:be9a00ea-a696-4aaa-be11-b5198ea1bb36 for instance 4cbde000-0844-4305-9309-31a6e53167a7 on hv-cinder-85199 Aug 26 18:28:38.342658 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-1cd2fe8b-7daf-4575-9221-dd3e58c2ef64 req-9e521e52-7eaa-4975-8bfa-11af23cbf0f7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040881 Aug 26 18:28:38.344221 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 372/732] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:38.710287 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2b0bfe44-6abf-4e05-97dc-d929d7645a86 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:38.711085 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2b0bfe44-6abf-4e05-97dc-d929d7645a86 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:38.726197 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2b0bfe44-6abf-4e05-97dc-d929d7645a86 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:38.726890 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2b0bfe44-6abf-4e05-97dc-d929d7645a86 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:38.729622 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2b0bfe44-6abf-4e05-97dc-d929d7645a86 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:38.730588 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2b0bfe44-6abf-4e05-97dc-d929d7645a86 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:38.731170 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2b0bfe44-6abf-4e05-97dc-d929d7645a86 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:38.731704 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2b0bfe44-6abf-4e05-97dc-d929d7645a86 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:38.856967 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2b0bfe44-6abf-4e05-97dc-d929d7645a86 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:38.868322 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2b0bfe44-6abf-4e05-97dc-d929d7645a86 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1295 microversion: 2.1 time: 0.161875 Aug 26 18:28:38.869829 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 361/733] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:38 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1295 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:38.888697 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d469ce72-6fee-4231-ae6d-38ca188ab302 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:38.889626 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d469ce72-6fee-4231-ae6d-38ca188ab302 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 64b399c3-d3a3-4193-9826-e509b3b9b529] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:38.906134 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d469ce72-6fee-4231-ae6d-38ca188ab302 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:38.906835 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d469ce72-6fee-4231-ae6d-38ca188ab302 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:38.907740 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d469ce72-6fee-4231-ae6d-38ca188ab302 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:38.909528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d469ce72-6fee-4231-ae6d-38ca188ab302 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:38.911378 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d469ce72-6fee-4231-ae6d-38ca188ab302 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:38.912396 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d469ce72-6fee-4231-ae6d-38ca188ab302 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:38.940903 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-d469ce72-6fee-4231-ae6d-38ca188ab302 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] HTTP exception thrown: Instance 64b399c3-d3a3-4193-9826-e509b3b9b529 could not be found. Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d469ce72-6fee-4231-ae6d-38ca188ab302 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Request method failure captured: Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 HTTP/1.1 Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ-q3zm4iqYsaqe6bB_XUaX46zVzzw5UqiDi0-NWNM8uHB_C5he6uznHk9eGLXg2ymLBubpgUrHzXL84c_lo2S7oVUjU4Q0PoVOxgY1frPPZbjfxZpPuL-Bvosu5RLz3DtLT6Icwl-SAd9UlXmMJkuBN-9ExPAx31BGg6XtRADVIRq0 Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 1a8356be55fb4b19a95da8b77c6e2f9a Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1193523936 Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:28:38.946064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:28:38.947558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1a8356be55fb4b19a95da8b77c6e2f9a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1a8356be55fb4b19a95da8b77c6e2f9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1a8356be55fb4b19a95da8b77c6e2f9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1a8356be55fb4b19a95da8b77c6e2f9a"}]}] Aug 26 18:28:38.947558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1193523936 Aug 26 18:28:38.947558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 1a8356be55fb4b19a95da8b77c6e2f9a Aug 26 18:28:38.947558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1193523936 Aug 26 18:28:38.947558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-ServerRescueNegativeTestJSON-1193523936-project Aug 26 18:28:38.947558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:28:38.947558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:28:38.947558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: c78657cb0d4144cfaf0a7be1e3388ed0 Aug 26 18:28:38.947558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1193523936-project Aug 26 18:28:38.947558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:28:38.947558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance 64b399c3-d3a3-4193-9826-e509b3b9b529 could not be found. Aug 26 18:28:38.947558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': '64b399c3-d3a3-4193-9826-e509b3b9b529'} Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64b399c3-d3a3-4193-9826-e509b3b9b529 could not be found. Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:28:38.948299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64b399c3-d3a3-4193-9826-e509b3b9b529 could not be found. Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64b399c3-d3a3-4193-9826-e509b3b9b529 could not be found. Aug 26 18:28:38.949643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:38.954182 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d469ce72-6fee-4231-ae6d-38ca188ab302 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Returning 404 to user: Instance 64b399c3-d3a3-4193-9826-e509b3b9b529 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:28:38.955307 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d469ce72-6fee-4231-ae6d-38ca188ab302 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529" status: 404 len: 111 microversion: 2.1 time: 0.070846 Aug 26 18:28:38.960255 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 373/734] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:38 2022] GET /compute/v2.1/servers/64b399c3-d3a3-4193-9826-e509b3b9b529 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:28:38.965950 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f19359e1-0915-406c-b61c-96693a4980c6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '.version_select at 0x7fc744238550>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:39.017622 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4c07699e-af41-4ef8-92f5-d5302648b0ee tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:39.019660 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4c07699e-af41-4ef8-92f5-d5302648b0ee tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:39.026886 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f19359e1-0915-406c-b61c-96693a4980c6 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417452474" status: 202 len: 0 microversion: 2.1 time: 0.065318 Aug 26 18:28:39.027485 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 362/735] 10.222.0.45 () {58 vars in 1221 bytes} [Fri Aug 26 18:28:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417452474 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:28:39.032441 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c07699e-af41-4ef8-92f5-d5302648b0ee tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:39.035424 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c07699e-af41-4ef8-92f5-d5302648b0ee tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:39.037945 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c07699e-af41-4ef8-92f5-d5302648b0ee tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:39.040659 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c07699e-af41-4ef8-92f5-d5302648b0ee tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:39.042575 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c07699e-af41-4ef8-92f5-d5302648b0ee tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:39.043319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c07699e-af41-4ef8-92f5-d5302648b0ee tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:39.093401 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c07699e-af41-4ef8-92f5-d5302648b0ee tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:39.094645 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c07699e-af41-4ef8-92f5-d5302648b0ee tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:39.095315 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c07699e-af41-4ef8-92f5-d5302648b0ee tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:39.095822 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-4c07699e-af41-4ef8-92f5-d5302648b0ee tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lazy-loading 'fault' on Instance uuid 5b0208ae-2692-4fda-adb6-946c6cec83ae {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:28:39.360972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4c07699e-af41-4ef8-92f5-d5302648b0ee tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8b301eeb0c4cbda40494e57ba78e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19db2164fb9439c8b079f2baf661b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:39.371967 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4c07699e-af41-4ef8-92f5-d5302648b0ee tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 200 len: 1309 microversion: 2.1 time: 0.357912 Aug 26 18:28:39.373533 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 374/736] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:39 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 1309 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:28:39.890101 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0c02090f-0657-4e7b-a083-851a494afaa9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:39.890994 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-0c02090f-0657-4e7b-a083-851a494afaa9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:39.899247 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0c02090f-0657-4e7b-a083-851a494afaa9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:39.900432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0c02090f-0657-4e7b-a083-851a494afaa9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:39.901248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0c02090f-0657-4e7b-a083-851a494afaa9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:39.902427 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0c02090f-0657-4e7b-a083-851a494afaa9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:39.903065 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0c02090f-0657-4e7b-a083-851a494afaa9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:39.903491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0c02090f-0657-4e7b-a083-851a494afaa9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:40.210018 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0c02090f-0657-4e7b-a083-851a494afaa9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:40.219085 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-0c02090f-0657-4e7b-a083-851a494afaa9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1362 microversion: 2.1 time: 0.333037 Aug 26 18:28:40.219897 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 363/737] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:39 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:40.391637 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-cdf6409c-fd31-4194-ae51-ab0c6e156d85 req-0f37ec3a-5ae8-4cd2-b693-4f1fcfa7e001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0208ae-2692-4fda-adb6-946c6cec83ae", "name": "network-vif-deleted", "tag": "7f27addd-0afe-46bb-b1ec-6d8f2557e27c"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:40.402860 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2bd0eb01-ce25-46b1-81b4-d4196f7e3093 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:40.404080 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2bd0eb01-ce25-46b1-81b4-d4196f7e3093 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] [instance: 5b0208ae-2692-4fda-adb6-946c6cec83ae] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:40.405810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cdf6409c-fd31-4194-ae51-ab0c6e156d85 req-0f37ec3a-5ae8-4cd2-b693-4f1fcfa7e001 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:40.406296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cdf6409c-fd31-4194-ae51-ab0c6e156d85 req-0f37ec3a-5ae8-4cd2-b693-4f1fcfa7e001 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:40.406722 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cdf6409c-fd31-4194-ae51-ab0c6e156d85 req-0f37ec3a-5ae8-4cd2-b693-4f1fcfa7e001 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:40.413421 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2bd0eb01-ce25-46b1-81b4-d4196f7e3093 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:40.414159 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2bd0eb01-ce25-46b1-81b4-d4196f7e3093 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:40.415081 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2bd0eb01-ce25-46b1-81b4-d4196f7e3093 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:40.416386 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2bd0eb01-ce25-46b1-81b4-d4196f7e3093 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:40.417093 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2bd0eb01-ce25-46b1-81b4-d4196f7e3093 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:40.418840 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2bd0eb01-ce25-46b1-81b4-d4196f7e3093 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:40.430336 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-cdf6409c-fd31-4194-ae51-ab0c6e156d85 req-0f37ec3a-5ae8-4cd2-b693-4f1fcfa7e001 service nova] Creating event network-vif-deleted:7f27addd-0afe-46bb-b1ec-6d8f2557e27c for instance 5b0208ae-2692-4fda-adb6-946c6cec83ae on hv-cinder-85199 Aug 26 18:28:40.436534 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-cdf6409c-fd31-4194-ae51-ab0c6e156d85 req-0f37ec3a-5ae8-4cd2-b693-4f1fcfa7e001 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050219 Aug 26 18:28:40.436989 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-2bd0eb01-ce25-46b1-81b4-d4196f7e3093 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] HTTP exception thrown: Instance 5b0208ae-2692-4fda-adb6-946c6cec83ae could not be found. Aug 26 18:28:40.437528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 375/738] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2bd0eb01-ce25-46b1-81b4-d4196f7e3093 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Request method failure captured: Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae HTTP/1.1 Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCRBTCyyME1hxnmQ5axDEq7BFAqYpEU2Q3nwQo-781sJNZwSpi8OWUV7i2qujm4ijMW3_Q7jrFKabCzhykEclIl1_cX7JSghWm7_9Kof7ux_rZpBcPGDi-jIDcUlJXyhZXgAozm5a4pxyh2zZ70cDdpwYP5WsB7BnxPt1kNKthUaPsv8 Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: e19db2164fb9439c8b079f2baf661b40 Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-VolumesSnapshotTestJSON-60066652 Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:28:40.440774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:28:40.442441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e19db2164fb9439c8b079f2baf661b40", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e19db2164fb9439c8b079f2baf661b40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e19db2164fb9439c8b079f2baf661b40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e19db2164fb9439c8b079f2baf661b40"}]}] Aug 26 18:28:40.442441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-VolumesSnapshotTestJSON-60066652 Aug 26 18:28:40.442441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: e19db2164fb9439c8b079f2baf661b40 Aug 26 18:28:40.442441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-60066652 Aug 26 18:28:40.442441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-VolumesSnapshotTestJSON-60066652-project Aug 26 18:28:40.442441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:28:40.442441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:28:40.442441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: 6a8b301eeb0c4cbda40494e57ba78e52 Aug 26 18:28:40.442441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-VolumesSnapshotTestJSON-60066652-project Aug 26 18:28:40.442441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:28:40.442441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance 5b0208ae-2692-4fda-adb6-946c6cec83ae could not be found. Aug 26 18:28:40.442441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '5b0208ae-2692-4fda-adb6-946c6cec83ae'} Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0208ae-2692-4fda-adb6-946c6cec83ae could not be found. Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:28:40.443184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0208ae-2692-4fda-adb6-946c6cec83ae could not be found. Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0208ae-2692-4fda-adb6-946c6cec83ae could not be found. Aug 26 18:28:40.444347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:40.446371 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2bd0eb01-ce25-46b1-81b4-d4196f7e3093 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] Returning 404 to user: Instance 5b0208ae-2692-4fda-adb6-946c6cec83ae could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:28:40.446371 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2bd0eb01-ce25-46b1-81b4-d4196f7e3093 tempest-VolumesSnapshotTestJSON-60066652 tempest-VolumesSnapshotTestJSON-60066652-project] 10.222.0.45 "GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae" status: 404 len: 111 microversion: 2.1 time: 0.048975 Aug 26 18:28:40.446371 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 364/739] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:40 2022] GET /compute/v2.1/servers/5b0208ae-2692-4fda-adb6-946c6cec83ae => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:28:41.237206 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:41.241803 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-44759726-9b15-4a8d-928d-6503671bf44d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:41.242508 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-44759726-9b15-4a8d-928d-6503671bf44d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:41.249312 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44759726-9b15-4a8d-928d-6503671bf44d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:41.249805 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44759726-9b15-4a8d-928d-6503671bf44d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:41.250244 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44759726-9b15-4a8d-928d-6503671bf44d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:41.250919 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44759726-9b15-4a8d-928d-6503671bf44d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:41.251373 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44759726-9b15-4a8d-928d-6503671bf44d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:41.251847 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44759726-9b15-4a8d-928d-6503671bf44d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:41.254639 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:41.390629 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-44759726-9b15-4a8d-928d-6503671bf44d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:41.398493 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-44759726-9b15-4a8d-928d-6503671bf44d tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1362 microversion: 2.1 time: 0.162273 Aug 26 18:28:41.399140 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 376/740] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:41 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:42.420126 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ca72f7b8-d486-40fc-8c10-9a7948b97313 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:42.420756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ca72f7b8-d486-40fc-8c10-9a7948b97313 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:42.422798 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:42.423449 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=6 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:42.430120 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ca72f7b8-d486-40fc-8c10-9a7948b97313 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:42.430609 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ca72f7b8-d486-40fc-8c10-9a7948b97313 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:42.431075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ca72f7b8-d486-40fc-8c10-9a7948b97313 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:42.431785 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ca72f7b8-d486-40fc-8c10-9a7948b97313 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:42.432234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ca72f7b8-d486-40fc-8c10-9a7948b97313 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:42.432655 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ca72f7b8-d486-40fc-8c10-9a7948b97313 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:42.465822 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-ec79617a-cc21-454e-b8f1-f997f3e4c9a7 req-b9b4a829-bed6-4f7e-bcd8-124f328c1b0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64b2c53-9597-4ccd-bb49-9fdf93a2c329", "tag": "a8354f77-3734-470c-82e7-511d8aeb71c2"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:42.472356 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ec79617a-cc21-454e-b8f1-f997f3e4c9a7 req-b9b4a829-bed6-4f7e-bcd8-124f328c1b0a service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:42.472860 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ec79617a-cc21-454e-b8f1-f997f3e4c9a7 req-b9b4a829-bed6-4f7e-bcd8-124f328c1b0a service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:42.473291 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ec79617a-cc21-454e-b8f1-f997f3e4c9a7 req-b9b4a829-bed6-4f7e-bcd8-124f328c1b0a service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:42.485793 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-ec79617a-cc21-454e-b8f1-f997f3e4c9a7 req-b9b4a829-bed6-4f7e-bcd8-124f328c1b0a service nova] Creating event network-changed:a8354f77-3734-470c-82e7-511d8aeb71c2 for instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 on hv-cinder-85199 Aug 26 18:28:42.492853 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-ec79617a-cc21-454e-b8f1-f997f3e4c9a7 req-b9b4a829-bed6-4f7e-bcd8-124f328c1b0a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034185 Aug 26 18:28:42.493468 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 377/741] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:42.498671 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9a9c82d6-3590-41ad-9b18-7a448f583128 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:42.499317 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9a9c82d6-3590-41ad-9b18-7a448f583128 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:42.506795 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a9c82d6-3590-41ad-9b18-7a448f583128 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:42.507299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a9c82d6-3590-41ad-9b18-7a448f583128 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:42.508655 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a9c82d6-3590-41ad-9b18-7a448f583128 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:42.509420 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a9c82d6-3590-41ad-9b18-7a448f583128 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:42.509882 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a9c82d6-3590-41ad-9b18-7a448f583128 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:42.510308 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a9c82d6-3590-41ad-9b18-7a448f583128 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:42.537710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9a9c82d6-3590-41ad-9b18-7a448f583128 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:28:42.576941 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ca72f7b8-d486-40fc-8c10-9a7948b97313 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:42.585647 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ca72f7b8-d486-40fc-8c10-9a7948b97313 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1362 microversion: 2.1 time: 0.169327 Aug 26 18:28:42.586248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 365/742] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:42 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:42.626682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9a9c82d6-3590-41ad-9b18-7a448f583128 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "DELETE /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 204 len: 0 microversion: 2.1 time: 0.131693 Aug 26 18:28:42.627290 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 378/743] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:28:42 2022] DELETE /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:28:42.635483 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2bc84436-f4f5-4e50-8fed-17f172c6011f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:42.636096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2bc84436-f4f5-4e50-8fed-17f172c6011f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:42.642805 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2bc84436-f4f5-4e50-8fed-17f172c6011f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:42.643286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2bc84436-f4f5-4e50-8fed-17f172c6011f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:42.643714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2bc84436-f4f5-4e50-8fed-17f172c6011f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:42.644409 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2bc84436-f4f5-4e50-8fed-17f172c6011f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:42.644889 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2bc84436-f4f5-4e50-8fed-17f172c6011f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:42.645306 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2bc84436-f4f5-4e50-8fed-17f172c6011f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:42.718770 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-77d2c4c5-d885-4a15-a004-68a17fe4705a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:42.719350 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-77d2c4c5-d885-4a15-a004-68a17fe4705a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:42.725817 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77d2c4c5-d885-4a15-a004-68a17fe4705a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:42.726355 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77d2c4c5-d885-4a15-a004-68a17fe4705a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:42.726780 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77d2c4c5-d885-4a15-a004-68a17fe4705a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:42.727476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77d2c4c5-d885-4a15-a004-68a17fe4705a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:42.727924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77d2c4c5-d885-4a15-a004-68a17fe4705a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:42.728440 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77d2c4c5-d885-4a15-a004-68a17fe4705a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:42.755070 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-77d2c4c5-d885-4a15-a004-68a17fe4705a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:28:42.787607 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2bc84436-f4f5-4e50-8fed-17f172c6011f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:42.796308 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2bc84436-f4f5-4e50-8fed-17f172c6011f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1580 microversion: 2.1 time: 0.164648 Aug 26 18:28:42.796935 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 366/744] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:42 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1580 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:42.835835 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-77d2c4c5-d885-4a15-a004-68a17fe4705a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 204 len: 0 microversion: 2.1 time: 0.121036 Aug 26 18:28:42.836439 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 379/745] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:28:42 2022] DELETE /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 18:28:42.845478 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-31cc54b5-cb9e-4246-b11a-6a4e8fae2913 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:42.846127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-31cc54b5-cb9e-4246-b11a-6a4e8fae2913 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:42.852354 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-31cc54b5-cb9e-4246-b11a-6a4e8fae2913 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:42.852876 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-31cc54b5-cb9e-4246-b11a-6a4e8fae2913 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:42.853298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-31cc54b5-cb9e-4246-b11a-6a4e8fae2913 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:42.853987 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-31cc54b5-cb9e-4246-b11a-6a4e8fae2913 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:42.854429 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-31cc54b5-cb9e-4246-b11a-6a4e8fae2913 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:42.854840 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-31cc54b5-cb9e-4246-b11a-6a4e8fae2913 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:42.998248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-31cc54b5-cb9e-4246-b11a-6a4e8fae2913 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:43.008976 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-31cc54b5-cb9e-4246-b11a-6a4e8fae2913 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1509 microversion: 2.1 time: 0.167392 Aug 26 18:28:43.009581 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 367/746] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:42 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:43.608374 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dab31cc7-a810-4b36-9a98-c4af59ce8282 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:43.609136 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dab31cc7-a810-4b36-9a98-c4af59ce8282 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:43.616436 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dab31cc7-a810-4b36-9a98-c4af59ce8282 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:43.616954 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dab31cc7-a810-4b36-9a98-c4af59ce8282 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:43.617379 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dab31cc7-a810-4b36-9a98-c4af59ce8282 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:43.618085 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dab31cc7-a810-4b36-9a98-c4af59ce8282 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:43.618538 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dab31cc7-a810-4b36-9a98-c4af59ce8282 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:43.618953 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dab31cc7-a810-4b36-9a98-c4af59ce8282 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:43.762610 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dab31cc7-a810-4b36-9a98-c4af59ce8282 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:43.770921 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dab31cc7-a810-4b36-9a98-c4af59ce8282 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1362 microversion: 2.1 time: 0.166775 Aug 26 18:28:43.771481 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 380/747] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:43 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:43.817879 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e93379ba-d433-4d4a-b1fb-719c00d693d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:43.818427 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e93379ba-d433-4d4a-b1fb-719c00d693d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:43.825319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e93379ba-d433-4d4a-b1fb-719c00d693d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:43.825797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e93379ba-d433-4d4a-b1fb-719c00d693d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:43.826223 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e93379ba-d433-4d4a-b1fb-719c00d693d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:43.826910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e93379ba-d433-4d4a-b1fb-719c00d693d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:43.827354 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e93379ba-d433-4d4a-b1fb-719c00d693d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:43.827769 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e93379ba-d433-4d4a-b1fb-719c00d693d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:43.970158 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e93379ba-d433-4d4a-b1fb-719c00d693d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:43.978229 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e93379ba-d433-4d4a-b1fb-719c00d693d5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1580 microversion: 2.1 time: 0.164424 Aug 26 18:28:43.978934 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 368/748] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:43 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1580 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:44.030904 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-07e5e29a-1317-45b1-be00-1afe71d1f209 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:44.031514 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-07e5e29a-1317-45b1-be00-1afe71d1f209 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:44.037986 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07e5e29a-1317-45b1-be00-1afe71d1f209 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:44.038490 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07e5e29a-1317-45b1-be00-1afe71d1f209 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:44.038906 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07e5e29a-1317-45b1-be00-1afe71d1f209 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:44.039610 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07e5e29a-1317-45b1-be00-1afe71d1f209 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:44.040053 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07e5e29a-1317-45b1-be00-1afe71d1f209 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:44.040475 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07e5e29a-1317-45b1-be00-1afe71d1f209 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:44.176886 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-07e5e29a-1317-45b1-be00-1afe71d1f209 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:44.184860 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-07e5e29a-1317-45b1-be00-1afe71d1f209 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1509 microversion: 2.1 time: 0.157945 Aug 26 18:28:44.185446 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 381/749] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:44 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:44.792284 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-cf0fc0be-81a3-44d0-858c-f561666dade3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:44.792908 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-cf0fc0be-81a3-44d0-858c-f561666dade3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:44.799426 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cf0fc0be-81a3-44d0-858c-f561666dade3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:44.799908 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cf0fc0be-81a3-44d0-858c-f561666dade3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:44.800344 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cf0fc0be-81a3-44d0-858c-f561666dade3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:44.801085 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cf0fc0be-81a3-44d0-858c-f561666dade3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:44.801566 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cf0fc0be-81a3-44d0-858c-f561666dade3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:44.801987 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cf0fc0be-81a3-44d0-858c-f561666dade3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:44.986196 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-cf0fc0be-81a3-44d0-858c-f561666dade3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:44.995915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-cf0fc0be-81a3-44d0-858c-f561666dade3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1362 microversion: 2.1 time: 0.207503 Aug 26 18:28:44.996655 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 369/750] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:44 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:45.001220 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-36a9c1e1-d0d3-4bb5-ab33-ced298b5b7b7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:45.002096 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-36a9c1e1-d0d3-4bb5-ab33-ced298b5b7b7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:45.009523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36a9c1e1-d0d3-4bb5-ab33-ced298b5b7b7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:45.010162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36a9c1e1-d0d3-4bb5-ab33-ced298b5b7b7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:45.010652 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36a9c1e1-d0d3-4bb5-ab33-ced298b5b7b7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:45.011584 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36a9c1e1-d0d3-4bb5-ab33-ced298b5b7b7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:45.012283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36a9c1e1-d0d3-4bb5-ab33-ced298b5b7b7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:45.012789 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36a9c1e1-d0d3-4bb5-ab33-ced298b5b7b7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:45.178935 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-36a9c1e1-d0d3-4bb5-ab33-ced298b5b7b7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:45.187883 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-36a9c1e1-d0d3-4bb5-ab33-ced298b5b7b7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1580 microversion: 2.1 time: 0.191961 Aug 26 18:28:45.188548 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 382/751] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:44 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1580 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:45.206226 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0741f7cc-ca8d-4b2e-a8e7-546ed590dfdc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:45.207043 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-0741f7cc-ca8d-4b2e-a8e7-546ed590dfdc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:45.215461 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0741f7cc-ca8d-4b2e-a8e7-546ed590dfdc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:45.216078 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0741f7cc-ca8d-4b2e-a8e7-546ed590dfdc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:45.216571 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0741f7cc-ca8d-4b2e-a8e7-546ed590dfdc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:45.217490 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0741f7cc-ca8d-4b2e-a8e7-546ed590dfdc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:45.217943 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0741f7cc-ca8d-4b2e-a8e7-546ed590dfdc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:45.218365 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0741f7cc-ca8d-4b2e-a8e7-546ed590dfdc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:45.372363 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0741f7cc-ca8d-4b2e-a8e7-546ed590dfdc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:45.381132 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-0741f7cc-ca8d-4b2e-a8e7-546ed590dfdc tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1509 microversion: 2.1 time: 0.178953 Aug 26 18:28:45.395792 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 370/752] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:45 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1509 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:46.081585 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6059610a-72ae-472c-a49c-1684420d6085 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:46.082176 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6059610a-72ae-472c-a49c-1684420d6085 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:46.088970 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6059610a-72ae-472c-a49c-1684420d6085 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:46.089462 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6059610a-72ae-472c-a49c-1684420d6085 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:46.089895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6059610a-72ae-472c-a49c-1684420d6085 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:46.090607 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6059610a-72ae-472c-a49c-1684420d6085 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:46.091056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6059610a-72ae-472c-a49c-1684420d6085 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:46.091478 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6059610a-72ae-472c-a49c-1684420d6085 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:46.209439 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f7dea3ef-4e4c-4d81-a502-8b019ad2413d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:46.210161 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f7dea3ef-4e4c-4d81-a502-8b019ad2413d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:46.216900 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7dea3ef-4e4c-4d81-a502-8b019ad2413d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:46.217379 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7dea3ef-4e4c-4d81-a502-8b019ad2413d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:46.217808 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7dea3ef-4e4c-4d81-a502-8b019ad2413d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:46.218512 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7dea3ef-4e4c-4d81-a502-8b019ad2413d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:46.218957 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7dea3ef-4e4c-4d81-a502-8b019ad2413d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:46.219354 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f7dea3ef-4e4c-4d81-a502-8b019ad2413d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:46.255879 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6059610a-72ae-472c-a49c-1684420d6085 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:46.264310 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6059610a-72ae-472c-a49c-1684420d6085 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1362 microversion: 2.1 time: 0.250681 Aug 26 18:28:46.264954 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 383/753] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:46 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:46.361520 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f7dea3ef-4e4c-4d81-a502-8b019ad2413d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:46.372245 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f7dea3ef-4e4c-4d81-a502-8b019ad2413d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1580 microversion: 2.1 time: 0.166560 Aug 26 18:28:46.372837 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 371/754] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:46 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1580 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:46.405102 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e04fd0a4-b7ae-493c-8a8c-1e03c31c371d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:46.406077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e04fd0a4-b7ae-493c-8a8c-1e03c31c371d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:46.413283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e04fd0a4-b7ae-493c-8a8c-1e03c31c371d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:46.413782 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e04fd0a4-b7ae-493c-8a8c-1e03c31c371d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:46.414211 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e04fd0a4-b7ae-493c-8a8c-1e03c31c371d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:46.414901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e04fd0a4-b7ae-493c-8a8c-1e03c31c371d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:46.415432 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e04fd0a4-b7ae-493c-8a8c-1e03c31c371d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:46.415863 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e04fd0a4-b7ae-493c-8a8c-1e03c31c371d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:46.551917 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e04fd0a4-b7ae-493c-8a8c-1e03c31c371d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:46.560337 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e04fd0a4-b7ae-493c-8a8c-1e03c31c371d tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1509 microversion: 2.1 time: 0.161176 Aug 26 18:28:46.560919 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 384/755] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:46 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:47.019921 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-2517c057-cd03-4d28-bece-7c3cb975e2a0 req-b9d40be7-a2c6-417f-a414-d8864959cb70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64b2c53-9597-4ccd-bb49-9fdf93a2c329", "name": "network-vif-plugged", "status": "completed", "tag": "a8354f77-3734-470c-82e7-511d8aeb71c2"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:47.030812 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2517c057-cd03-4d28-bece-7c3cb975e2a0 req-b9d40be7-a2c6-417f-a414-d8864959cb70 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:47.031895 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2517c057-cd03-4d28-bece-7c3cb975e2a0 req-b9d40be7-a2c6-417f-a414-d8864959cb70 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:47.032318 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2517c057-cd03-4d28-bece-7c3cb975e2a0 req-b9d40be7-a2c6-417f-a414-d8864959cb70 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:47.047137 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-2517c057-cd03-4d28-bece-7c3cb975e2a0 req-b9d40be7-a2c6-417f-a414-d8864959cb70 service nova] Creating event network-vif-plugged:a8354f77-3734-470c-82e7-511d8aeb71c2 for instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 on hv-cinder-85199 Aug 26 18:28:47.052867 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-2517c057-cd03-4d28-bece-7c3cb975e2a0 req-b9d40be7-a2c6-417f-a414-d8864959cb70 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036605 Aug 26 18:28:47.053446 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 372/756] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:47.287131 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-67e670ef-2266-4c19-bb2c-248490a4aa62 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:47.287749 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-67e670ef-2266-4c19-bb2c-248490a4aa62 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:47.298460 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67e670ef-2266-4c19-bb2c-248490a4aa62 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:47.298946 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67e670ef-2266-4c19-bb2c-248490a4aa62 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:47.299369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67e670ef-2266-4c19-bb2c-248490a4aa62 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:47.300067 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67e670ef-2266-4c19-bb2c-248490a4aa62 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:47.300510 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67e670ef-2266-4c19-bb2c-248490a4aa62 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:47.300963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67e670ef-2266-4c19-bb2c-248490a4aa62 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:47.394291 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-558d9fca-55cf-4d3e-9971-1aa4ba89ac5c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:47.395089 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-558d9fca-55cf-4d3e-9971-1aa4ba89ac5c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:47.402574 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-558d9fca-55cf-4d3e-9971-1aa4ba89ac5c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:47.403067 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-558d9fca-55cf-4d3e-9971-1aa4ba89ac5c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:47.403478 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-558d9fca-55cf-4d3e-9971-1aa4ba89ac5c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:47.404191 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-558d9fca-55cf-4d3e-9971-1aa4ba89ac5c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:47.404634 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-558d9fca-55cf-4d3e-9971-1aa4ba89ac5c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:47.405111 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-558d9fca-55cf-4d3e-9971-1aa4ba89ac5c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:47.443956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-67e670ef-2266-4c19-bb2c-248490a4aa62 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:47.452283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-67e670ef-2266-4c19-bb2c-248490a4aa62 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1362 microversion: 2.1 time: 0.169468 Aug 26 18:28:47.452909 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 385/757] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:47 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:47.548444 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-558d9fca-55cf-4d3e-9971-1aa4ba89ac5c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:47.556767 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-558d9fca-55cf-4d3e-9971-1aa4ba89ac5c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1580 microversion: 2.1 time: 0.166730 Aug 26 18:28:47.557358 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 373/758] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:47 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1580 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:47.585019 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6a5fc547-516c-49a8-b739-52b40c57261e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:47.585658 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6a5fc547-516c-49a8-b739-52b40c57261e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:47.591947 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a5fc547-516c-49a8-b739-52b40c57261e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:47.592402 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a5fc547-516c-49a8-b739-52b40c57261e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:47.592875 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a5fc547-516c-49a8-b739-52b40c57261e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:47.593580 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a5fc547-516c-49a8-b739-52b40c57261e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:47.594032 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a5fc547-516c-49a8-b739-52b40c57261e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:47.594456 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a5fc547-516c-49a8-b739-52b40c57261e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:47.743728 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6a5fc547-516c-49a8-b739-52b40c57261e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:47.754769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6a5fc547-516c-49a8-b739-52b40c57261e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1509 microversion: 2.1 time: 0.173795 Aug 26 18:28:47.755349 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 386/759] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:47 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:48.473376 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-6c7110e7-b7d6-4c39-b691-4349f59bdc01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:48.474077 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-6c7110e7-b7d6-4c39-b691-4349f59bdc01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:48.480822 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c7110e7-b7d6-4c39-b691-4349f59bdc01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:48.481321 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c7110e7-b7d6-4c39-b691-4349f59bdc01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:48.481743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c7110e7-b7d6-4c39-b691-4349f59bdc01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:48.482445 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c7110e7-b7d6-4c39-b691-4349f59bdc01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:48.482913 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c7110e7-b7d6-4c39-b691-4349f59bdc01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:48.483407 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6c7110e7-b7d6-4c39-b691-4349f59bdc01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:48.577888 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-991d99f5-8512-4edd-8a13-6074a64d6c03 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:48.578591 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-991d99f5-8512-4edd-8a13-6074a64d6c03 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:48.586788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991d99f5-8512-4edd-8a13-6074a64d6c03 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:48.587468 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991d99f5-8512-4edd-8a13-6074a64d6c03 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:48.587977 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991d99f5-8512-4edd-8a13-6074a64d6c03 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:48.589029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991d99f5-8512-4edd-8a13-6074a64d6c03 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:48.589467 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991d99f5-8512-4edd-8a13-6074a64d6c03 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:48.589963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991d99f5-8512-4edd-8a13-6074a64d6c03 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:48.626926 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6c7110e7-b7d6-4c39-b691-4349f59bdc01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:48.637617 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-6c7110e7-b7d6-4c39-b691-4349f59bdc01 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1362 microversion: 2.1 time: 0.168311 Aug 26 18:28:48.638329 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 374/760] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:48 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:48.733798 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-991d99f5-8512-4edd-8a13-6074a64d6c03 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:48.741942 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-991d99f5-8512-4edd-8a13-6074a64d6c03 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1580 microversion: 2.1 time: 0.167866 Aug 26 18:28:48.742533 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 387/761] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:48 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1580 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:48.777680 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0bffbce7-5126-4183-b64c-1a69572d485c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:48.778710 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-0bffbce7-5126-4183-b64c-1a69572d485c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:48.786637 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0bffbce7-5126-4183-b64c-1a69572d485c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:48.787702 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0bffbce7-5126-4183-b64c-1a69572d485c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:48.788603 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0bffbce7-5126-4183-b64c-1a69572d485c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:48.789647 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0bffbce7-5126-4183-b64c-1a69572d485c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:48.790409 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0bffbce7-5126-4183-b64c-1a69572d485c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:48.791050 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0bffbce7-5126-4183-b64c-1a69572d485c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:49.135151 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0bffbce7-5126-4183-b64c-1a69572d485c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:49.144988 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-0bffbce7-5126-4183-b64c-1a69572d485c tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1509 microversion: 2.1 time: 0.371901 Aug 26 18:28:49.145490 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 375/762] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:48 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1509 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:49.662525 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e11c8ea5-8c06-4832-a28e-b6deb9d67360 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:49.663140 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e11c8ea5-8c06-4832-a28e-b6deb9d67360 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:49.669902 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e11c8ea5-8c06-4832-a28e-b6deb9d67360 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:49.670440 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e11c8ea5-8c06-4832-a28e-b6deb9d67360 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:49.670964 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e11c8ea5-8c06-4832-a28e-b6deb9d67360 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:49.671709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e11c8ea5-8c06-4832-a28e-b6deb9d67360 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:49.672164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e11c8ea5-8c06-4832-a28e-b6deb9d67360 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:49.672590 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e11c8ea5-8c06-4832-a28e-b6deb9d67360 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:49.764003 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e713b86e-77d3-43ea-b6ff-6c22de06d87c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:49.765126 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e713b86e-77d3-43ea-b6ff-6c22de06d87c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:49.771978 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e713b86e-77d3-43ea-b6ff-6c22de06d87c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:49.772707 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e713b86e-77d3-43ea-b6ff-6c22de06d87c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:49.773163 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e713b86e-77d3-43ea-b6ff-6c22de06d87c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:49.774033 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e713b86e-77d3-43ea-b6ff-6c22de06d87c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:49.776061 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e713b86e-77d3-43ea-b6ff-6c22de06d87c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:49.776699 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e713b86e-77d3-43ea-b6ff-6c22de06d87c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:49.849644 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e11c8ea5-8c06-4832-a28e-b6deb9d67360 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:49.857919 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e11c8ea5-8c06-4832-a28e-b6deb9d67360 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1362 microversion: 2.1 time: 0.199493 Aug 26 18:28:49.858514 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 388/763] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:49 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:50.103413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e713b86e-77d3-43ea-b6ff-6c22de06d87c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:50.111400 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e713b86e-77d3-43ea-b6ff-6c22de06d87c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1580 microversion: 2.1 time: 0.352187 Aug 26 18:28:50.112011 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 376/764] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:49 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1580 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:28:50.168779 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c01ba304-47fc-4f67-b1be-cf34f3583f83 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:50.170198 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c01ba304-47fc-4f67-b1be-cf34f3583f83 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:50.178778 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c01ba304-47fc-4f67-b1be-cf34f3583f83 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:50.179381 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c01ba304-47fc-4f67-b1be-cf34f3583f83 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:50.179812 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c01ba304-47fc-4f67-b1be-cf34f3583f83 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:50.180516 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c01ba304-47fc-4f67-b1be-cf34f3583f83 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:50.180990 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c01ba304-47fc-4f67-b1be-cf34f3583f83 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:50.181411 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c01ba304-47fc-4f67-b1be-cf34f3583f83 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:50.263385 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c01ba304-47fc-4f67-b1be-cf34f3583f83 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:50.272094 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c01ba304-47fc-4f67-b1be-cf34f3583f83 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1467 microversion: 2.1 time: 0.108198 Aug 26 18:28:50.272692 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 389/765] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:50 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1467 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:50.328150 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-171a9ffe-06fa-49ef-96fb-f0c6a211d97e req-48bcb4b8-65ca-471e-bc37-3a8f66535766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6262b31b-ccd3-40d7-8258-7414e80e5893", "name": "network-vif-deleted", "tag": "ac74a58e-fb20-452c-9734-c6b8f5f60492"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:50.338170 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-171a9ffe-06fa-49ef-96fb-f0c6a211d97e req-48bcb4b8-65ca-471e-bc37-3a8f66535766 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:50.339027 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-171a9ffe-06fa-49ef-96fb-f0c6a211d97e req-48bcb4b8-65ca-471e-bc37-3a8f66535766 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:50.339688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-171a9ffe-06fa-49ef-96fb-f0c6a211d97e req-48bcb4b8-65ca-471e-bc37-3a8f66535766 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:50.354495 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-171a9ffe-06fa-49ef-96fb-f0c6a211d97e req-48bcb4b8-65ca-471e-bc37-3a8f66535766 service nova] Creating event network-vif-deleted:ac74a58e-fb20-452c-9734-c6b8f5f60492 for instance 6262b31b-ccd3-40d7-8258-7414e80e5893 on hv-cinder-85199 Aug 26 18:28:50.359715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-171a9ffe-06fa-49ef-96fb-f0c6a211d97e req-48bcb4b8-65ca-471e-bc37-3a8f66535766 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035538 Aug 26 18:28:50.360740 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 377/766] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:50.880968 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2f66d06b-4605-4962-8ab1-2425787494b3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:50.881695 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2f66d06b-4605-4962-8ab1-2425787494b3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:50.884425 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:50.890519 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f66d06b-4605-4962-8ab1-2425787494b3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:50.891094 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f66d06b-4605-4962-8ab1-2425787494b3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:50.891578 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f66d06b-4605-4962-8ab1-2425787494b3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:50.892399 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f66d06b-4605-4962-8ab1-2425787494b3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:50.892977 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f66d06b-4605-4962-8ab1-2425787494b3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:50.893545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f66d06b-4605-4962-8ab1-2425787494b3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:50.897555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:51.043248 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2f66d06b-4605-4962-8ab1-2425787494b3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:51.052571 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2f66d06b-4605-4962-8ab1-2425787494b3 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1362 microversion: 2.1 time: 0.175450 Aug 26 18:28:51.053298 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 390/767] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:50 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:51.134805 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-88eda724-d2cb-474c-b151-3e65ed70e7e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:51.135479 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-88eda724-d2cb-474c-b151-3e65ed70e7e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:51.142425 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-88eda724-d2cb-474c-b151-3e65ed70e7e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:51.142925 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-88eda724-d2cb-474c-b151-3e65ed70e7e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:51.143349 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-88eda724-d2cb-474c-b151-3e65ed70e7e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:51.144062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-88eda724-d2cb-474c-b151-3e65ed70e7e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:51.144512 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-88eda724-d2cb-474c-b151-3e65ed70e7e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:51.144950 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-88eda724-d2cb-474c-b151-3e65ed70e7e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:51.214549 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-88eda724-d2cb-474c-b151-3e65ed70e7e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:51.224297 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-88eda724-d2cb-474c-b151-3e65ed70e7e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1512 microversion: 2.1 time: 0.094500 Aug 26 18:28:51.226034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 378/768] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:51 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1512 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:51.294597 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1c6acba1-3f8a-4c80-9e64-ef2f4296f74f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:51.295323 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1c6acba1-3f8a-4c80-9e64-ef2f4296f74f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:51.301876 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6acba1-3f8a-4c80-9e64-ef2f4296f74f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:51.302334 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6acba1-3f8a-4c80-9e64-ef2f4296f74f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:51.302763 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6acba1-3f8a-4c80-9e64-ef2f4296f74f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:51.303459 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6acba1-3f8a-4c80-9e64-ef2f4296f74f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:51.303901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6acba1-3f8a-4c80-9e64-ef2f4296f74f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:51.304318 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6acba1-3f8a-4c80-9e64-ef2f4296f74f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:51.372608 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1c6acba1-3f8a-4c80-9e64-ef2f4296f74f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:51.380704 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1c6acba1-3f8a-4c80-9e64-ef2f4296f74f tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1467 microversion: 2.1 time: 0.090025 Aug 26 18:28:51.393735 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 391/769] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:51 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1467 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:52.080201 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-53ed8600-c473-40b0-a012-ab80af9690f2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:52.081018 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-53ed8600-c473-40b0-a012-ab80af9690f2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:52.087355 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-53ed8600-c473-40b0-a012-ab80af9690f2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:52.087840 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-53ed8600-c473-40b0-a012-ab80af9690f2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:52.088268 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-53ed8600-c473-40b0-a012-ab80af9690f2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:52.088989 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-53ed8600-c473-40b0-a012-ab80af9690f2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:52.089439 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-53ed8600-c473-40b0-a012-ab80af9690f2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:52.089858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-53ed8600-c473-40b0-a012-ab80af9690f2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:52.228834 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-53ed8600-c473-40b0-a012-ab80af9690f2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:52.232429 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=100 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:28:52.237613 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-53ed8600-c473-40b0-a012-ab80af9690f2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1362 microversion: 2.1 time: 0.163881 Aug 26 18:28:52.238182 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 379/770] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:52 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:52.245946 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f58a06ac-ef5f-4b47-94ea-02a1bfe076b0 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:52.246726 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f58a06ac-ef5f-4b47-94ea-02a1bfe076b0 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:52.253721 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f58a06ac-ef5f-4b47-94ea-02a1bfe076b0 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:52.254220 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f58a06ac-ef5f-4b47-94ea-02a1bfe076b0 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:52.254651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f58a06ac-ef5f-4b47-94ea-02a1bfe076b0 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:52.255355 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f58a06ac-ef5f-4b47-94ea-02a1bfe076b0 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:52.255806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f58a06ac-ef5f-4b47-94ea-02a1bfe076b0 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:52.256231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f58a06ac-ef5f-4b47-94ea-02a1bfe076b0 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:52.323247 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f58a06ac-ef5f-4b47-94ea-02a1bfe076b0 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:52.331475 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f58a06ac-ef5f-4b47-94ea-02a1bfe076b0 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1512 microversion: 2.1 time: 0.089490 Aug 26 18:28:52.332071 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 392/771] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:52 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1512 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:52.380646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-efa9e597-03c7-4130-88f7-4e4f0948e1e6 req-b50ad76f-09be-4eeb-8dcc-17f07c3da228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570e7fd4-4295-4f3c-9d2a-02f704ea6100", "name": "network-vif-deleted", "tag": "fa397c67-c193-42fd-b326-362149109be9"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:52.390346 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-efa9e597-03c7-4130-88f7-4e4f0948e1e6 req-b50ad76f-09be-4eeb-8dcc-17f07c3da228 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:52.390826 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-efa9e597-03c7-4130-88f7-4e4f0948e1e6 req-b50ad76f-09be-4eeb-8dcc-17f07c3da228 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:52.391255 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-efa9e597-03c7-4130-88f7-4e4f0948e1e6 req-b50ad76f-09be-4eeb-8dcc-17f07c3da228 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:52.405496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-efa9e597-03c7-4130-88f7-4e4f0948e1e6 req-b50ad76f-09be-4eeb-8dcc-17f07c3da228 service nova] Creating event network-vif-deleted:fa397c67-c193-42fd-b326-362149109be9 for instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 on hv-cinder-85199 Aug 26 18:28:52.407063 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5978544c-1b82-4315-b180-da1923eaff99 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:52.407682 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5978544c-1b82-4315-b180-da1923eaff99 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:52.411634 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-efa9e597-03c7-4130-88f7-4e4f0948e1e6 req-b50ad76f-09be-4eeb-8dcc-17f07c3da228 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035516 Aug 26 18:28:52.412603 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 380/772] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:52.414568 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5978544c-1b82-4315-b180-da1923eaff99 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:52.414996 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5978544c-1b82-4315-b180-da1923eaff99 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:52.415553 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5978544c-1b82-4315-b180-da1923eaff99 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:52.416257 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5978544c-1b82-4315-b180-da1923eaff99 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:52.416751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5978544c-1b82-4315-b180-da1923eaff99 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:52.417175 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5978544c-1b82-4315-b180-da1923eaff99 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:52.481598 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5978544c-1b82-4315-b180-da1923eaff99 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:52.489797 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5978544c-1b82-4315-b180-da1923eaff99 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1467 microversion: 2.1 time: 0.090110 Aug 26 18:28:52.490418 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 393/773] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:52 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1467 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:53.259841 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2483b27e-c3f2-4df8-ac16-40a191c7dbe4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:53.260863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2483b27e-c3f2-4df8-ac16-40a191c7dbe4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:53.267645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2483b27e-c3f2-4df8-ac16-40a191c7dbe4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:53.268133 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2483b27e-c3f2-4df8-ac16-40a191c7dbe4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:53.268564 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2483b27e-c3f2-4df8-ac16-40a191c7dbe4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:53.269292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2483b27e-c3f2-4df8-ac16-40a191c7dbe4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:53.269749 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2483b27e-c3f2-4df8-ac16-40a191c7dbe4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:53.270169 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2483b27e-c3f2-4df8-ac16-40a191c7dbe4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:53.353083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ee4969e3-b818-4124-bdeb-b40d65170ff1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:53.353721 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ee4969e3-b818-4124-bdeb-b40d65170ff1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:53.361315 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee4969e3-b818-4124-bdeb-b40d65170ff1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:53.361848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee4969e3-b818-4124-bdeb-b40d65170ff1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:53.362282 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee4969e3-b818-4124-bdeb-b40d65170ff1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:53.363005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee4969e3-b818-4124-bdeb-b40d65170ff1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:53.363483 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee4969e3-b818-4124-bdeb-b40d65170ff1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:53.363907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee4969e3-b818-4124-bdeb-b40d65170ff1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:53.399482 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee4969e3-b818-4124-bdeb-b40d65170ff1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:53.400240 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee4969e3-b818-4124-bdeb-b40d65170ff1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:53.401285 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee4969e3-b818-4124-bdeb-b40d65170ff1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:53.401896 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-ee4969e3-b818-4124-bdeb-b40d65170ff1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lazy-loading 'fault' on Instance uuid 570e7fd4-4295-4f3c-9d2a-02f704ea6100 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:28:53.418903 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2483b27e-c3f2-4df8-ac16-40a191c7dbe4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:53.436078 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2483b27e-c3f2-4df8-ac16-40a191c7dbe4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1362 microversion: 2.1 time: 0.179129 Aug 26 18:28:53.449552 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 381/774] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:53 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:53.454189 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ee4969e3-b818-4124-bdeb-b40d65170ff1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:53.463869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ee4969e3-b818-4124-bdeb-b40d65170ff1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 200 len: 1231 microversion: 2.1 time: 0.114835 Aug 26 18:28:53.477368 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 394/775] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:53 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 1231 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:53.511976 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2594a702-9fa6-4a65-a902-7594062d983a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:53.512514 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2594a702-9fa6-4a65-a902-7594062d983a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:53.518623 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2594a702-9fa6-4a65-a902-7594062d983a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:53.519343 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2594a702-9fa6-4a65-a902-7594062d983a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:53.519937 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2594a702-9fa6-4a65-a902-7594062d983a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:53.520861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2594a702-9fa6-4a65-a902-7594062d983a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:53.521310 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2594a702-9fa6-4a65-a902-7594062d983a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:53.521733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2594a702-9fa6-4a65-a902-7594062d983a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:53.558304 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2594a702-9fa6-4a65-a902-7594062d983a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:53.558819 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2594a702-9fa6-4a65-a902-7594062d983a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:53.560030 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2594a702-9fa6-4a65-a902-7594062d983a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:53.560487 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-2594a702-9fa6-4a65-a902-7594062d983a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lazy-loading 'fault' on Instance uuid 6262b31b-ccd3-40d7-8258-7414e80e5893 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:28:53.605616 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2594a702-9fa6-4a65-a902-7594062d983a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:53.614625 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2594a702-9fa6-4a65-a902-7594062d983a tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 200 len: 1312 microversion: 2.1 time: 0.106579 Aug 26 18:28:53.615321 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 382/776] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:53 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:54.455739 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-94731793-426e-4408-a38f-f55605b2826b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:54.456364 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-94731793-426e-4408-a38f-f55605b2826b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:54.463281 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94731793-426e-4408-a38f-f55605b2826b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:54.463773 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94731793-426e-4408-a38f-f55605b2826b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:54.464211 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94731793-426e-4408-a38f-f55605b2826b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:54.464953 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94731793-426e-4408-a38f-f55605b2826b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:54.465404 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94731793-426e-4408-a38f-f55605b2826b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:54.465835 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94731793-426e-4408-a38f-f55605b2826b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:54.486916 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4d25b641-72ed-4dbf-97c7-96b4aa67f7f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:54.487566 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4d25b641-72ed-4dbf-97c7-96b4aa67f7f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:54.494659 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4d25b641-72ed-4dbf-97c7-96b4aa67f7f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:54.495203 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4d25b641-72ed-4dbf-97c7-96b4aa67f7f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:54.495608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4d25b641-72ed-4dbf-97c7-96b4aa67f7f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:54.496341 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4d25b641-72ed-4dbf-97c7-96b4aa67f7f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:54.496820 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4d25b641-72ed-4dbf-97c7-96b4aa67f7f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:54.497228 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4d25b641-72ed-4dbf-97c7-96b4aa67f7f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:54.512459 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-4d25b641-72ed-4dbf-97c7-96b4aa67f7f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] HTTP exception thrown: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4d25b641-72ed-4dbf-97c7-96b4aa67f7f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Request method failure captured: Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 HTTP/1.1 Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCRATVSFMwvvIZWe5xQ7_c9wMzq45KN3regMiKZhz9BIvXRzjokJpVP2h6qNC1tqKIQi-iiNodWQB_0pB1eXuMPI55r9OuEq0wInvBnvVmMueTrED7lp4GfwjKMoINP91kJLs6kOCYJV5KJjcHgkuBq-D4R3KJHQcULUqKaTjGb7DUJk Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 44c9832086724954853fc474a2a92747 Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-TestVolumeBootPattern-1464331371 Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:28:54.514209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:28:54.515836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_44c9832086724954853fc474a2a92747", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/44c9832086724954853fc474a2a92747"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/44c9832086724954853fc474a2a92747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/44c9832086724954853fc474a2a92747"}]}] Aug 26 18:28:54.515836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-TestVolumeBootPattern-1464331371 Aug 26 18:28:54.515836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 44c9832086724954853fc474a2a92747 Aug 26 18:28:54.515836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-TestVolumeBootPattern-1464331371 Aug 26 18:28:54.515836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-TestVolumeBootPattern-1464331371-project Aug 26 18:28:54.515836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:28:54.515836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:28:54.515836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: deb80cf02c84476182960a91d69b6da1 Aug 26 18:28:54.515836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-TestVolumeBootPattern-1464331371-project Aug 26 18:28:54.515836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:28:54.515836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. Aug 26 18:28:54.515836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '570e7fd4-4295-4f3c-9d2a-02f704ea6100'} Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:28:54.516797 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. Aug 26 18:28:54.518608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:28:54.520014 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4d25b641-72ed-4dbf-97c7-96b4aa67f7f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Returning 404 to user: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:28:54.520014 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4d25b641-72ed-4dbf-97c7-96b4aa67f7f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 404 len: 111 microversion: 2.1 time: 0.032846 Aug 26 18:28:54.520014 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 383/777] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:54 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:28:54.609139 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-94731793-426e-4408-a38f-f55605b2826b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:54.617145 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-94731793-426e-4408-a38f-f55605b2826b tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1548 microversion: 2.1 time: 0.165297 Aug 26 18:28:54.617714 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 395/778] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:54 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:54.623357 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1973925438", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1811114461", "security_groups": [{"name": "tempest-secgroup-smoke-1399502428"}], "block_device_mapping_v2": [{"uuid": "9482360e-704d-4ae9-92ba-08515ea5b8cc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a8763208-a644-423d-b288-ce6ba4bfee8d"}]}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:54.635347 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a777b236-4dc1-4461-8604-6d7b88e0dba4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:54.635990 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a777b236-4dc1-4461-8604-6d7b88e0dba4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6262b31b-ccd3-40d7-8258-7414e80e5893] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:54.642183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a777b236-4dc1-4461-8604-6d7b88e0dba4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:54.642676 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a777b236-4dc1-4461-8604-6d7b88e0dba4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:54.643103 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a777b236-4dc1-4461-8604-6d7b88e0dba4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:54.644219 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a777b236-4dc1-4461-8604-6d7b88e0dba4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:54.644671 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a777b236-4dc1-4461-8604-6d7b88e0dba4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:54.645177 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a777b236-4dc1-4461-8604-6d7b88e0dba4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:54.659859 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-a777b236-4dc1-4461-8604-6d7b88e0dba4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] HTTP exception thrown: Instance 6262b31b-ccd3-40d7-8258-7414e80e5893 could not be found. Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a777b236-4dc1-4461-8604-6d7b88e0dba4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Request method failure captured: Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 HTTP/1.1 Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ-q3zm4iqYsaqe6bB_XUaX46zVzzw5UqiDi0-NWNM8uHB_C5he6uznHk9eGLXg2ymLBubpgUrHzXL84c_lo2S7oVUjU4Q0PoVOxgY1frPPZbjfxZpPuL-Bvosu5RLz3DtLT6Icwl-SAd9UlXmMJkuBN-9ExPAx31BGg6XtRADVIRq0 Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 1a8356be55fb4b19a95da8b77c6e2f9a Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1193523936 Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:28:54.661555 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:28:54.663124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1a8356be55fb4b19a95da8b77c6e2f9a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1a8356be55fb4b19a95da8b77c6e2f9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1a8356be55fb4b19a95da8b77c6e2f9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1a8356be55fb4b19a95da8b77c6e2f9a"}]}] Aug 26 18:28:54.663124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1193523936 Aug 26 18:28:54.663124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 1a8356be55fb4b19a95da8b77c6e2f9a Aug 26 18:28:54.663124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1193523936 Aug 26 18:28:54.663124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-ServerRescueNegativeTestJSON-1193523936-project Aug 26 18:28:54.663124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:28:54.663124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:28:54.663124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: c78657cb0d4144cfaf0a7be1e3388ed0 Aug 26 18:28:54.663124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1193523936-project Aug 26 18:28:54.663124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:28:54.663124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance 6262b31b-ccd3-40d7-8258-7414e80e5893 could not be found. Aug 26 18:28:54.663124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': '6262b31b-ccd3-40d7-8258-7414e80e5893'} Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6262b31b-ccd3-40d7-8258-7414e80e5893 could not be found. Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:28:54.664419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6262b31b-ccd3-40d7-8258-7414e80e5893 could not be found. Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6262b31b-ccd3-40d7-8258-7414e80e5893 could not be found. Aug 26 18:28:54.667729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:28:54.670080 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a777b236-4dc1-4461-8604-6d7b88e0dba4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Returning 404 to user: Instance 6262b31b-ccd3-40d7-8258-7414e80e5893 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:28:54.670080 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a777b236-4dc1-4461-8604-6d7b88e0dba4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893" status: 404 len: 111 microversion: 2.1 time: 0.031540 Aug 26 18:28:54.670080 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 396/779] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:54 2022] GET /compute/v2.1/servers/6262b31b-ccd3-40d7-8258-7414e80e5893 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:28:54.670080 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5594fb81-7f88-4e66-b813-9c07537d0f16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:54.670080 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5594fb81-7f88-4e66-b813-9c07537d0f16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:54.675669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5594fb81-7f88-4e66-b813-9c07537d0f16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:54.676154 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5594fb81-7f88-4e66-b813-9c07537d0f16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:54.676575 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5594fb81-7f88-4e66-b813-9c07537d0f16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:54.677416 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5594fb81-7f88-4e66-b813-9c07537d0f16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:54.677743 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5594fb81-7f88-4e66-b813-9c07537d0f16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:54.678272 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5594fb81-7f88-4e66-b813-9c07537d0f16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:54.746594 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.network.neutron [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] validate_networks() for [('a8763208-a644-423d-b288-ce6ba4bfee8d', None, None, None, None, None)] {{(pid=120540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:28:54.761047 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5594fb81-7f88-4e66-b813-9c07537d0f16 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095986 Aug 26 18:28:54.761742 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 397/780] 10.222.0.45 () {58 vars in 1275 bytes} [Fri Aug 26 18:28:54 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:54.766769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7db0f8f9-a205-4b77-988e-5560a35a3e65 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:54.767280 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7db0f8f9-a205-4b77-988e-5560a35a3e65 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:54.773784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7db0f8f9-a205-4b77-988e-5560a35a3e65 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:54.774265 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7db0f8f9-a205-4b77-988e-5560a35a3e65 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:54.774697 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7db0f8f9-a205-4b77-988e-5560a35a3e65 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:54.775389 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7db0f8f9-a205-4b77-988e-5560a35a3e65 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:54.776178 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7db0f8f9-a205-4b77-988e-5560a35a3e65 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:54.776593 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7db0f8f9-a205-4b77-988e-5560a35a3e65 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:54.803725 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7db0f8f9-a205-4b77-988e-5560a35a3e65 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:28:54.932768 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7db0f8f9-a205-4b77-988e-5560a35a3e65 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 204 len: 0 microversion: 2.1 time: 0.159613 Aug 26 18:28:54.932768 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 398/781] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:28:54 2022] DELETE /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:28:54.934535 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9acf63b5-ea14-40e7-ba1d-0607dd0bdb60 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:54.935182 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9acf63b5-ea14-40e7-ba1d-0607dd0bdb60 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:54.943095 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9acf63b5-ea14-40e7-ba1d-0607dd0bdb60 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:54.943762 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9acf63b5-ea14-40e7-ba1d-0607dd0bdb60 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:54.944258 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9acf63b5-ea14-40e7-ba1d-0607dd0bdb60 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:54.944999 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9acf63b5-ea14-40e7-ba1d-0607dd0bdb60 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:54.945499 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9acf63b5-ea14-40e7-ba1d-0607dd0bdb60 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:54.946790 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9acf63b5-ea14-40e7-ba1d-0607dd0bdb60 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:55.257084 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Flavor limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:28:55.257495 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Image limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:28:55.258059 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Flavor pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:28:55.258530 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Image pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:28:55.258940 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:28:55.266542 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9acf63b5-ea14-40e7-ba1d-0607dd0bdb60 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:55.270633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:55.271224 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:55.271657 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:55.272388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:55.273000 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:55.273470 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:55.277661 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9acf63b5-ea14-40e7-ba1d-0607dd0bdb60 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.347802 Aug 26 18:28:55.278544 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 399/782] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:54 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:55.298746 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Getting quotas for project 44c9832086724954853fc474a2a92747. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:28:55.305283 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Getting quotas for user deb80cf02c84476182960a91d69b6da1 and project 44c9832086724954853fc474a2a92747. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:28:55.381997 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Going to run 1 instances... {{(pid=120540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:28:55.384171 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9482360e-704d-4ae9-92ba-08515ea5b8cc',volume_size=None,volume_type=None)] {{(pid=120540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:28:55.537427 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ae439d77-f114-4ea8-a193-0fc13561d22b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.918006 Aug 26 18:28:55.538525 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 384/783] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:28:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 18:28:55.549725 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d000965-d8cd-4a2c-b067-fc1c70da4193 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:55.550361 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7d000965-d8cd-4a2c-b067-fc1c70da4193 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:55.615423 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7d000965-d8cd-4a2c-b067-fc1c70da4193 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:55.622782 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7d000965-d8cd-4a2c-b067-fc1c70da4193 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1095 microversion: 2.1 time: 0.077116 Aug 26 18:28:55.623671 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 400/784] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:55 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:55.936424 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-19129757-7f98-4424-9e17-e0d0cb241084 req-9ed1da73-eca9-4e1d-b5ff-e09c55a563fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64b2c53-9597-4ccd-bb49-9fdf93a2c329", "tag": "a8354f77-3734-470c-82e7-511d8aeb71c2"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:55.947596 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-19129757-7f98-4424-9e17-e0d0cb241084 req-9ed1da73-eca9-4e1d-b5ff-e09c55a563fd service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:55.948386 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-19129757-7f98-4424-9e17-e0d0cb241084 req-9ed1da73-eca9-4e1d-b5ff-e09c55a563fd service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:55.948841 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-19129757-7f98-4424-9e17-e0d0cb241084 req-9ed1da73-eca9-4e1d-b5ff-e09c55a563fd service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:55.960409 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-19129757-7f98-4424-9e17-e0d0cb241084 req-9ed1da73-eca9-4e1d-b5ff-e09c55a563fd service nova] Creating event network-changed:a8354f77-3734-470c-82e7-511d8aeb71c2 for instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 on hv-cinder-85199 Aug 26 18:28:55.967288 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-19129757-7f98-4424-9e17-e0d0cb241084 req-9ed1da73-eca9-4e1d-b5ff-e09c55a563fd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033052 Aug 26 18:28:55.968975 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 385/785] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:56.299793 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0265ac9c-edcc-4ad6-91d6-ace8a4372dc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:56.300932 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0265ac9c-edcc-4ad6-91d6-ace8a4372dc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:56.308669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0265ac9c-edcc-4ad6-91d6-ace8a4372dc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:56.309248 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0265ac9c-edcc-4ad6-91d6-ace8a4372dc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:56.309687 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0265ac9c-edcc-4ad6-91d6-ace8a4372dc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:56.310679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0265ac9c-edcc-4ad6-91d6-ace8a4372dc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:56.311105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0265ac9c-edcc-4ad6-91d6-ace8a4372dc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:56.311524 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0265ac9c-edcc-4ad6-91d6-ace8a4372dc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:56.452525 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0265ac9c-edcc-4ad6-91d6-ace8a4372dc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:56.461359 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0265ac9c-edcc-4ad6-91d6-ace8a4372dc4 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.165558 Aug 26 18:28:56.462028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 401/786] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:56 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:56.645024 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e0616b26-9a85-41c5-9439-c2aa294d983a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:56.645788 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e0616b26-9a85-41c5-9439-c2aa294d983a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:56.652987 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e0616b26-9a85-41c5-9439-c2aa294d983a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:56.653511 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e0616b26-9a85-41c5-9439-c2aa294d983a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:56.653967 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e0616b26-9a85-41c5-9439-c2aa294d983a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:56.654661 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e0616b26-9a85-41c5-9439-c2aa294d983a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:56.655134 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e0616b26-9a85-41c5-9439-c2aa294d983a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:56.655560 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e0616b26-9a85-41c5-9439-c2aa294d983a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:56.721731 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e0616b26-9a85-41c5-9439-c2aa294d983a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:56.729717 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e0616b26-9a85-41c5-9439-c2aa294d983a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1145 microversion: 2.1 time: 0.089684 Aug 26 18:28:56.730290 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 386/787] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:56 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:57.483731 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c4c06f8e-66e3-47e3-a434-45a8dc41882e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:57.484349 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c4c06f8e-66e3-47e3-a434-45a8dc41882e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:57.491006 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4c06f8e-66e3-47e3-a434-45a8dc41882e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:57.491494 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4c06f8e-66e3-47e3-a434-45a8dc41882e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:57.491929 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4c06f8e-66e3-47e3-a434-45a8dc41882e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:57.492629 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4c06f8e-66e3-47e3-a434-45a8dc41882e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:57.493293 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4c06f8e-66e3-47e3-a434-45a8dc41882e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:57.493783 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4c06f8e-66e3-47e3-a434-45a8dc41882e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:57.634493 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c4c06f8e-66e3-47e3-a434-45a8dc41882e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:57.643361 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c4c06f8e-66e3-47e3-a434-45a8dc41882e tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.163568 Aug 26 18:28:57.643960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 402/788] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:57 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:57.751277 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7d260616-af41-48bd-85c5-26651993a2d7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:57.751910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-7d260616-af41-48bd-85c5-26651993a2d7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:57.758979 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7d260616-af41-48bd-85c5-26651993a2d7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:57.759462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7d260616-af41-48bd-85c5-26651993a2d7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:57.759898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7d260616-af41-48bd-85c5-26651993a2d7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:57.760593 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7d260616-af41-48bd-85c5-26651993a2d7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:57.761072 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7d260616-af41-48bd-85c5-26651993a2d7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:57.761490 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7d260616-af41-48bd-85c5-26651993a2d7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:57.835647 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-7d260616-af41-48bd-85c5-26651993a2d7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:57.843946 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-7d260616-af41-48bd-85c5-26651993a2d7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1145 microversion: 2.1 time: 0.096775 Aug 26 18:28:57.844566 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 387/789] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:57 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:58.667176 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d44d8a42-1389-4ab7-ad3f-6d48b3a706c9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:58.667876 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d44d8a42-1389-4ab7-ad3f-6d48b3a706c9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:58.674928 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d44d8a42-1389-4ab7-ad3f-6d48b3a706c9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:58.675506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d44d8a42-1389-4ab7-ad3f-6d48b3a706c9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:58.676171 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d44d8a42-1389-4ab7-ad3f-6d48b3a706c9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:58.677154 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d44d8a42-1389-4ab7-ad3f-6d48b3a706c9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:58.677673 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d44d8a42-1389-4ab7-ad3f-6d48b3a706c9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:58.678178 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d44d8a42-1389-4ab7-ad3f-6d48b3a706c9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:58.817862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d44d8a42-1389-4ab7-ad3f-6d48b3a706c9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:58.827177 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d44d8a42-1389-4ab7-ad3f-6d48b3a706c9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1521 microversion: 2.1 time: 0.164663 Aug 26 18:28:58.828340 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 403/790] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:58 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:58.866748 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-5fb43c66-8e20-4030-b822-66e301f15778 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:58.867347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-5fb43c66-8e20-4030-b822-66e301f15778 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:58.873980 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5fb43c66-8e20-4030-b822-66e301f15778 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:58.874472 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5fb43c66-8e20-4030-b822-66e301f15778 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:58.874908 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5fb43c66-8e20-4030-b822-66e301f15778 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:58.875611 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5fb43c66-8e20-4030-b822-66e301f15778 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:58.876054 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5fb43c66-8e20-4030-b822-66e301f15778 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:58.876469 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5fb43c66-8e20-4030-b822-66e301f15778 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:58.962159 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5fb43c66-8e20-4030-b822-66e301f15778 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:58.970482 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-5fb43c66-8e20-4030-b822-66e301f15778 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1193 microversion: 2.1 time: 0.107662 Aug 26 18:28:58.971103 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 388/791] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:58 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1193 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:59.698654 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-6389bb3e-03c5-44fd-a5aa-79239b81a31d req-8a111320-bf5e-4548-87c8-99ccea393810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6249cc1c-c171-41b8-81d5-2d73ed7735be", "name": "network-vif-deleted", "tag": "bac5114e-f74f-4b09-9068-4de5433c0fdf"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:28:59.712389 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-6389bb3e-03c5-44fd-a5aa-79239b81a31d req-8a111320-bf5e-4548-87c8-99ccea393810 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:59.713180 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-6389bb3e-03c5-44fd-a5aa-79239b81a31d req-8a111320-bf5e-4548-87c8-99ccea393810 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:59.714013 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-6389bb3e-03c5-44fd-a5aa-79239b81a31d req-8a111320-bf5e-4548-87c8-99ccea393810 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:59.731020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-6389bb3e-03c5-44fd-a5aa-79239b81a31d req-8a111320-bf5e-4548-87c8-99ccea393810 service nova] Creating event network-vif-deleted:bac5114e-f74f-4b09-9068-4de5433c0fdf for instance 6249cc1c-c171-41b8-81d5-2d73ed7735be on hv-cinder-85199 Aug 26 18:28:59.738005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-6389bb3e-03c5-44fd-a5aa-79239b81a31d req-8a111320-bf5e-4548-87c8-99ccea393810 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043944 Aug 26 18:28:59.739249 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 404/792] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:28:59.848079 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-134a3cc2-50f1-47aa-8d17-13824cdf1edd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:28:59.848690 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-134a3cc2-50f1-47aa-8d17-13824cdf1edd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:28:59.855593 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-134a3cc2-50f1-47aa-8d17-13824cdf1edd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:59.856083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-134a3cc2-50f1-47aa-8d17-13824cdf1edd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:59.856508 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-134a3cc2-50f1-47aa-8d17-13824cdf1edd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:59.857286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-134a3cc2-50f1-47aa-8d17-13824cdf1edd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:59.857789 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-134a3cc2-50f1-47aa-8d17-13824cdf1edd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:59.858167 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-134a3cc2-50f1-47aa-8d17-13824cdf1edd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:59.891386 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-134a3cc2-50f1-47aa-8d17-13824cdf1edd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:28:59.892031 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-134a3cc2-50f1-47aa-8d17-13824cdf1edd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:28:59.892289 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-134a3cc2-50f1-47aa-8d17-13824cdf1edd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:28:59.892762 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-134a3cc2-50f1-47aa-8d17-13824cdf1edd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lazy-loading 'fault' on Instance uuid 6249cc1c-c171-41b8-81d5-2d73ed7735be {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:28:59.948267 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-134a3cc2-50f1-47aa-8d17-13824cdf1edd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c78657cb0d4144cfaf0a7be1e3388ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8356be55fb4b19a95da8b77c6e2f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:28:59.959282 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-134a3cc2-50f1-47aa-8d17-13824cdf1edd tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 200 len: 1311 microversion: 2.1 time: 0.114973 Aug 26 18:28:59.960165 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 389/793] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:59 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:28:59.998840 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6dec16bf-0968-4e41-b642-bf51674e5fa7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:00.001745 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6dec16bf-0968-4e41-b642-bf51674e5fa7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:00.010490 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dec16bf-0968-4e41-b642-bf51674e5fa7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:00.013209 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dec16bf-0968-4e41-b642-bf51674e5fa7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:00.014614 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dec16bf-0968-4e41-b642-bf51674e5fa7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:00.015446 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dec16bf-0968-4e41-b642-bf51674e5fa7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:00.016000 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dec16bf-0968-4e41-b642-bf51674e5fa7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:00.019497 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dec16bf-0968-4e41-b642-bf51674e5fa7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:00.116329 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6dec16bf-0968-4e41-b642-bf51674e5fa7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:00.124793 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6dec16bf-0968-4e41-b642-bf51674e5fa7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1199 microversion: 2.1 time: 0.135414 Aug 26 18:29:00.125397 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 405/794] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:28:59 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1199 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:00.982987 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-680dea7a-280d-4308-95ed-63afe76b4fe9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:00.984486 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-680dea7a-280d-4308-95ed-63afe76b4fe9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] [instance: 6249cc1c-c171-41b8-81d5-2d73ed7735be] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:00.994925 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-680dea7a-280d-4308-95ed-63afe76b4fe9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:00.996155 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-680dea7a-280d-4308-95ed-63afe76b4fe9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:00.996784 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-680dea7a-280d-4308-95ed-63afe76b4fe9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:00.998831 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-680dea7a-280d-4308-95ed-63afe76b4fe9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:00.999943 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-680dea7a-280d-4308-95ed-63afe76b4fe9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:01.000941 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-680dea7a-280d-4308-95ed-63afe76b4fe9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:01.019517 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-680dea7a-280d-4308-95ed-63afe76b4fe9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] HTTP exception thrown: Instance 6249cc1c-c171-41b8-81d5-2d73ed7735be could not be found. Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-680dea7a-280d-4308-95ed-63afe76b4fe9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Request method failure captured: Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be HTTP/1.1 Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ-q3zm4iqYsaqe6bB_XUaX46zVzzw5UqiDi0-NWNM8uHB_C5he6uznHk9eGLXg2ymLBubpgUrHzXL84c_lo2S7oVUjU4Q0PoVOxgY1frPPZbjfxZpPuL-Bvosu5RLz3DtLT6Icwl-SAd9UlXmMJkuBN-9ExPAx31BGg6XtRADVIRq0 Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 1a8356be55fb4b19a95da8b77c6e2f9a Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1193523936 Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:29:01.022060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:29:01.023863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1a8356be55fb4b19a95da8b77c6e2f9a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1a8356be55fb4b19a95da8b77c6e2f9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1a8356be55fb4b19a95da8b77c6e2f9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1a8356be55fb4b19a95da8b77c6e2f9a"}]}] Aug 26 18:29:01.023863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1193523936 Aug 26 18:29:01.023863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 1a8356be55fb4b19a95da8b77c6e2f9a Aug 26 18:29:01.023863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1193523936 Aug 26 18:29:01.023863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-ServerRescueNegativeTestJSON-1193523936-project Aug 26 18:29:01.023863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:29:01.023863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:29:01.023863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: c78657cb0d4144cfaf0a7be1e3388ed0 Aug 26 18:29:01.023863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1193523936-project Aug 26 18:29:01.023863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:29:01.023863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance 6249cc1c-c171-41b8-81d5-2d73ed7735be could not be found. Aug 26 18:29:01.023863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '6249cc1c-c171-41b8-81d5-2d73ed7735be'} Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6249cc1c-c171-41b8-81d5-2d73ed7735be could not be found. Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:29:01.024915 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6249cc1c-c171-41b8-81d5-2d73ed7735be could not be found. Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6249cc1c-c171-41b8-81d5-2d73ed7735be could not be found. Aug 26 18:29:01.026535 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:29:01.028634 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-680dea7a-280d-4308-95ed-63afe76b4fe9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] Returning 404 to user: Instance 6249cc1c-c171-41b8-81d5-2d73ed7735be could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:29:01.029673 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-680dea7a-280d-4308-95ed-63afe76b4fe9 tempest-ServerRescueNegativeTestJSON-1193523936 tempest-ServerRescueNegativeTestJSON-1193523936-project] 10.222.0.45 "GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be" status: 404 len: 111 microversion: 2.1 time: 0.051110 Aug 26 18:29:01.030236 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 390/795] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:00 2022] GET /compute/v2.1/servers/6249cc1c-c171-41b8-81d5-2d73ed7735be => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:29:01.146121 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1c89582d-98f5-4326-b623-ae7cad6887da tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:01.146790 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1c89582d-98f5-4326-b623-ae7cad6887da tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:01.153819 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c89582d-98f5-4326-b623-ae7cad6887da tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:01.154303 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c89582d-98f5-4326-b623-ae7cad6887da tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:01.154788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c89582d-98f5-4326-b623-ae7cad6887da tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:01.155699 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c89582d-98f5-4326-b623-ae7cad6887da tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:01.156201 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c89582d-98f5-4326-b623-ae7cad6887da tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:01.156903 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c89582d-98f5-4326-b623-ae7cad6887da tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:01.413957 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1c89582d-98f5-4326-b623-ae7cad6887da tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:01.422511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1c89582d-98f5-4326-b623-ae7cad6887da tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1267 microversion: 2.1 time: 0.280584 Aug 26 18:29:01.423209 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 406/796] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:01 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1267 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:01.866994 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-76052b9f-b211-4d94-82e7-cd7cf6c1e16f req-e3e09c77-d5f7-4a24-9675-a7ff12ad5d2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af8ec60-dd9a-4455-b357-74fa237e37ee", "tag": "e7d8dd42-ffb0-4122-a71f-c660208d6944"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:01.876971 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-76052b9f-b211-4d94-82e7-cd7cf6c1e16f req-e3e09c77-d5f7-4a24-9675-a7ff12ad5d2d service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:01.877505 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-76052b9f-b211-4d94-82e7-cd7cf6c1e16f req-e3e09c77-d5f7-4a24-9675-a7ff12ad5d2d service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:01.877931 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-76052b9f-b211-4d94-82e7-cd7cf6c1e16f req-e3e09c77-d5f7-4a24-9675-a7ff12ad5d2d service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:01.889608 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-76052b9f-b211-4d94-82e7-cd7cf6c1e16f req-e3e09c77-d5f7-4a24-9675-a7ff12ad5d2d service nova] Creating event network-changed:e7d8dd42-ffb0-4122-a71f-c660208d6944 for instance 9af8ec60-dd9a-4455-b357-74fa237e37ee on hv-cinder-85199 Aug 26 18:29:01.894756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-76052b9f-b211-4d94-82e7-cd7cf6c1e16f req-e3e09c77-d5f7-4a24-9675-a7ff12ad5d2d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098763 Aug 26 18:29:01.895525 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 391/797] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:29:02.447851 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2076a9b0-9745-4ea4-a74d-33ab7e64c7e7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:02.449333 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2076a9b0-9745-4ea4-a74d-33ab7e64c7e7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:02.458827 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2076a9b0-9745-4ea4-a74d-33ab7e64c7e7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:02.459031 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2076a9b0-9745-4ea4-a74d-33ab7e64c7e7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:02.459524 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2076a9b0-9745-4ea4-a74d-33ab7e64c7e7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:02.460241 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2076a9b0-9745-4ea4-a74d-33ab7e64c7e7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:02.460690 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2076a9b0-9745-4ea4-a74d-33ab7e64c7e7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:02.461145 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2076a9b0-9745-4ea4-a74d-33ab7e64c7e7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:02.483266 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:02.716808 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2076a9b0-9745-4ea4-a74d-33ab7e64c7e7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:02.725204 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2076a9b0-9745-4ea4-a74d-33ab7e64c7e7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1267 microversion: 2.1 time: 0.284353 Aug 26 18:29:02.725814 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 407/798] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:02 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:03.747488 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ef89cea1-ac60-487f-890e-15ca0b658c78 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:03.748881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ef89cea1-ac60-487f-890e-15ca0b658c78 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:03.760829 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ef89cea1-ac60-487f-890e-15ca0b658c78 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:03.761541 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ef89cea1-ac60-487f-890e-15ca0b658c78 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:03.762828 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ef89cea1-ac60-487f-890e-15ca0b658c78 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:03.763747 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ef89cea1-ac60-487f-890e-15ca0b658c78 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:03.764445 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ef89cea1-ac60-487f-890e-15ca0b658c78 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:03.765037 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ef89cea1-ac60-487f-890e-15ca0b658c78 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:03.982845 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ef89cea1-ac60-487f-890e-15ca0b658c78 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:03.995914 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ef89cea1-ac60-487f-890e-15ca0b658c78 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1267 microversion: 2.1 time: 0.253304 Aug 26 18:29:03.998577 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 392/799] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:03 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:05.018997 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ed820e9a-2ef4-4047-be47-ca6088a5422b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:05.019639 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ed820e9a-2ef4-4047-be47-ca6088a5422b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:05.027730 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed820e9a-2ef4-4047-be47-ca6088a5422b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:05.028355 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed820e9a-2ef4-4047-be47-ca6088a5422b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:05.028911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed820e9a-2ef4-4047-be47-ca6088a5422b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:05.030011 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed820e9a-2ef4-4047-be47-ca6088a5422b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:05.030542 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed820e9a-2ef4-4047-be47-ca6088a5422b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:05.031044 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed820e9a-2ef4-4047-be47-ca6088a5422b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:05.202928 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ed820e9a-2ef4-4047-be47-ca6088a5422b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:05.211448 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ed820e9a-2ef4-4047-be47-ca6088a5422b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1267 microversion: 2.1 time: 0.196493 Aug 26 18:29:05.212004 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 408/800] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:05 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:06.295735 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e4475031-37a5-464c-abea-85e418f05dfc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:06.296370 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e4475031-37a5-464c-abea-85e418f05dfc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:06.298734 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:06.299398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=6 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:06.300161 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:06.306574 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e4475031-37a5-464c-abea-85e418f05dfc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:06.307062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e4475031-37a5-464c-abea-85e418f05dfc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:06.307497 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e4475031-37a5-464c-abea-85e418f05dfc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:06.308226 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e4475031-37a5-464c-abea-85e418f05dfc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:06.308680 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e4475031-37a5-464c-abea-85e418f05dfc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:06.309127 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e4475031-37a5-464c-abea-85e418f05dfc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:06.453932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e4475031-37a5-464c-abea-85e418f05dfc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:06.465591 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e4475031-37a5-464c-abea-85e418f05dfc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1267 microversion: 2.1 time: 0.173829 Aug 26 18:29:06.466194 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 393/801] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:06 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:07.486680 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-39c2faea-006c-4569-b30f-ff474d7869ec tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:07.487562 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-39c2faea-006c-4569-b30f-ff474d7869ec tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:07.489531 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:07.495493 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39c2faea-006c-4569-b30f-ff474d7869ec tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:07.495976 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39c2faea-006c-4569-b30f-ff474d7869ec tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:07.496422 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39c2faea-006c-4569-b30f-ff474d7869ec tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:07.497188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39c2faea-006c-4569-b30f-ff474d7869ec tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:07.497646 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39c2faea-006c-4569-b30f-ff474d7869ec tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:07.498065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39c2faea-006c-4569-b30f-ff474d7869ec tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:07.657777 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-39c2faea-006c-4569-b30f-ff474d7869ec tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:07.665667 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-39c2faea-006c-4569-b30f-ff474d7869ec tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1267 microversion: 2.1 time: 0.182965 Aug 26 18:29:07.666243 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 409/802] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:07 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:08.042119 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-a5040095-3bfd-4c59-9c2f-310ee9be333c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:08.043435 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-a5040095-3bfd-4c59-9c2f-310ee9be333c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:08.051014 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5040095-3bfd-4c59-9c2f-310ee9be333c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:08.051623 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5040095-3bfd-4c59-9c2f-310ee9be333c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:08.051987 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5040095-3bfd-4c59-9c2f-310ee9be333c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:08.052752 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5040095-3bfd-4c59-9c2f-310ee9be333c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:08.053317 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5040095-3bfd-4c59-9c2f-310ee9be333c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:08.053731 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5040095-3bfd-4c59-9c2f-310ee9be333c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:08.077942 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-a5040095-3bfd-4c59-9c2f-310ee9be333c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163/ips" status: 200 len: 151 microversion: 2.20 time: 0.231595 Aug 26 18:29:08.078489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 394/803] 10.222.0.45 () {60 vars in 1289 bytes} [Fri Aug 26 18:29:07 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163/ips => generated 151 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:29:08.690272 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2f38a18f-6614-4390-b4ba-d46a5c09c831 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:08.690892 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2f38a18f-6614-4390-b4ba-d46a5c09c831 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:08.700127 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f38a18f-6614-4390-b4ba-d46a5c09c831 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:08.700587 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f38a18f-6614-4390-b4ba-d46a5c09c831 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:08.701047 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f38a18f-6614-4390-b4ba-d46a5c09c831 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:08.701747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f38a18f-6614-4390-b4ba-d46a5c09c831 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:08.702188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f38a18f-6614-4390-b4ba-d46a5c09c831 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:08.702601 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f38a18f-6614-4390-b4ba-d46a5c09c831 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:08.867802 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2f38a18f-6614-4390-b4ba-d46a5c09c831 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:08.876745 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2f38a18f-6614-4390-b4ba-d46a5c09c831 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1267 microversion: 2.1 time: 0.190354 Aug 26 18:29:08.877345 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 410/804] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:08 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:09.899039 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-6f06e1e0-98a8-434a-83ce-361eb80b77c4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:09.900344 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-6f06e1e0-98a8-434a-83ce-361eb80b77c4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:09.907135 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f06e1e0-98a8-434a-83ce-361eb80b77c4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:09.907628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f06e1e0-98a8-434a-83ce-361eb80b77c4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:09.908066 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f06e1e0-98a8-434a-83ce-361eb80b77c4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:09.908792 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f06e1e0-98a8-434a-83ce-361eb80b77c4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:09.909307 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f06e1e0-98a8-434a-83ce-361eb80b77c4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:09.909655 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6f06e1e0-98a8-434a-83ce-361eb80b77c4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:10.061508 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6f06e1e0-98a8-434a-83ce-361eb80b77c4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:10.069873 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-6f06e1e0-98a8-434a-83ce-361eb80b77c4 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1267 microversion: 2.1 time: 0.175833 Aug 26 18:29:10.070552 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 395/805] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:09 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:10.130064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0341619a-e0a4-4860-b8ef-2354b550a6bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:10.130628 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0341619a-e0a4-4860-b8ef-2354b550a6bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:10.139811 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0341619a-e0a4-4860-b8ef-2354b550a6bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:10.139977 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0341619a-e0a4-4860-b8ef-2354b550a6bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:10.140467 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0341619a-e0a4-4860-b8ef-2354b550a6bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:10.141538 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0341619a-e0a4-4860-b8ef-2354b550a6bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:10.141996 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0341619a-e0a4-4860-b8ef-2354b550a6bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:10.142418 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0341619a-e0a4-4860-b8ef-2354b550a6bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:10.167423 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-0341619a-e0a4-4860-b8ef-2354b550a6bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lazy-loading 'flavor' on Instance uuid f82d25b8-bf09-48ca-9098-20bff440e163 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:29:10.390590 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0341619a-e0a4-4860-b8ef-2354b550a6bc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "POST /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163/action" status: 202 len: 0 microversion: 2.20 time: 0.264620 Aug 26 18:29:10.391348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 411/806] 10.222.0.45 () {62 vars in 1319 bytes} [Fri Aug 26 18:29:10 2022] POST /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:29:10.400695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8e359843-eae5-4510-8b04-0cc5c206611b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:10.402245 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8e359843-eae5-4510-8b04-0cc5c206611b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:10.407895 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8e359843-eae5-4510-8b04-0cc5c206611b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:10.408587 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8e359843-eae5-4510-8b04-0cc5c206611b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:10.409202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8e359843-eae5-4510-8b04-0cc5c206611b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:10.410025 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8e359843-eae5-4510-8b04-0cc5c206611b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:10.410482 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8e359843-eae5-4510-8b04-0cc5c206611b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:10.410869 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8e359843-eae5-4510-8b04-0cc5c206611b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:10.563777 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8e359843-eae5-4510-8b04-0cc5c206611b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:10.572357 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8e359843-eae5-4510-8b04-0cc5c206611b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:10.575036 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8e359843-eae5-4510-8b04-0cc5c206611b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:10.576397 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8e359843-eae5-4510-8b04-0cc5c206611b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.180266 Aug 26 18:29:10.576997 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 396/807] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:10 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:29:11.092876 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-151b9640-317b-4c6b-9f36-94d061c59c5e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:11.093564 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-151b9640-317b-4c6b-9f36-94d061c59c5e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:11.101457 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-151b9640-317b-4c6b-9f36-94d061c59c5e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:11.101973 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-151b9640-317b-4c6b-9f36-94d061c59c5e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:11.102470 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-151b9640-317b-4c6b-9f36-94d061c59c5e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:11.103228 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-151b9640-317b-4c6b-9f36-94d061c59c5e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:11.103680 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-151b9640-317b-4c6b-9f36-94d061c59c5e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:11.104096 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-151b9640-317b-4c6b-9f36-94d061c59c5e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:11.251972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-151b9640-317b-4c6b-9f36-94d061c59c5e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:11.261112 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-151b9640-317b-4c6b-9f36-94d061c59c5e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1267 microversion: 2.1 time: 0.172402 Aug 26 18:29:11.261771 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 412/808] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:11 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:11.600263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-6611ffa8-f494-46b4-a049-4fb93744dbe9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:11.600879 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-6611ffa8-f494-46b4-a049-4fb93744dbe9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:11.607963 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6611ffa8-f494-46b4-a049-4fb93744dbe9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:11.608447 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6611ffa8-f494-46b4-a049-4fb93744dbe9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:11.609006 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6611ffa8-f494-46b4-a049-4fb93744dbe9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:11.609720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6611ffa8-f494-46b4-a049-4fb93744dbe9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:11.610163 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6611ffa8-f494-46b4-a049-4fb93744dbe9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:11.610581 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6611ffa8-f494-46b4-a049-4fb93744dbe9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:11.762153 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6611ffa8-f494-46b4-a049-4fb93744dbe9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:11.771027 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6611ffa8-f494-46b4-a049-4fb93744dbe9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:11.772489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6611ffa8-f494-46b4-a049-4fb93744dbe9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:11.773787 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-6611ffa8-f494-46b4-a049-4fb93744dbe9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.177569 Aug 26 18:29:11.774336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 397/809] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:11 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:12.283190 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-53fa18bf-8029-46ea-b0ab-7393d43ea2ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:12.283797 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-53fa18bf-8029-46ea-b0ab-7393d43ea2ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:12.290749 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53fa18bf-8029-46ea-b0ab-7393d43ea2ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:12.291271 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53fa18bf-8029-46ea-b0ab-7393d43ea2ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:12.291690 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53fa18bf-8029-46ea-b0ab-7393d43ea2ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:12.292380 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53fa18bf-8029-46ea-b0ab-7393d43ea2ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:12.292853 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53fa18bf-8029-46ea-b0ab-7393d43ea2ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:12.293301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53fa18bf-8029-46ea-b0ab-7393d43ea2ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:12.434175 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-53fa18bf-8029-46ea-b0ab-7393d43ea2ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:12.442116 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-53fa18bf-8029-46ea-b0ab-7393d43ea2ef tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1267 microversion: 2.1 time: 0.162916 Aug 26 18:29:12.442702 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 413/810] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:12 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:12.630883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-2a427d06-0c2a-4282-8cdc-e9a5325018ea req-e89b9b6f-7551-4cb9-a8e4-15974ea433bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af8ec60-dd9a-4455-b357-74fa237e37ee", "name": "network-vif-plugged", "status": "completed", "tag": "e7d8dd42-ffb0-4122-a71f-c660208d6944"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:12.642985 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2a427d06-0c2a-4282-8cdc-e9a5325018ea req-e89b9b6f-7551-4cb9-a8e4-15974ea433bf service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:12.644211 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2a427d06-0c2a-4282-8cdc-e9a5325018ea req-e89b9b6f-7551-4cb9-a8e4-15974ea433bf service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:12.644646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2a427d06-0c2a-4282-8cdc-e9a5325018ea req-e89b9b6f-7551-4cb9-a8e4-15974ea433bf service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:12.657261 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-2a427d06-0c2a-4282-8cdc-e9a5325018ea req-e89b9b6f-7551-4cb9-a8e4-15974ea433bf service nova] Creating event network-vif-plugged:e7d8dd42-ffb0-4122-a71f-c660208d6944 for instance 9af8ec60-dd9a-4455-b357-74fa237e37ee on hv-cinder-85199 Aug 26 18:29:12.662604 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-2a427d06-0c2a-4282-8cdc-e9a5325018ea req-e89b9b6f-7551-4cb9-a8e4-15974ea433bf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035495 Aug 26 18:29:12.663416 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 398/811] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:29:12.798280 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-48928599-2f5f-4fb1-b3f6-02abebabc9d4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:12.799334 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-48928599-2f5f-4fb1-b3f6-02abebabc9d4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:12.809505 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48928599-2f5f-4fb1-b3f6-02abebabc9d4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:12.810527 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48928599-2f5f-4fb1-b3f6-02abebabc9d4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:12.810834 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48928599-2f5f-4fb1-b3f6-02abebabc9d4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:12.811717 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48928599-2f5f-4fb1-b3f6-02abebabc9d4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:12.812468 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48928599-2f5f-4fb1-b3f6-02abebabc9d4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:12.812895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48928599-2f5f-4fb1-b3f6-02abebabc9d4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:12.951411 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-48928599-2f5f-4fb1-b3f6-02abebabc9d4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:12.959906 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-48928599-2f5f-4fb1-b3f6-02abebabc9d4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:12.961466 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-48928599-2f5f-4fb1-b3f6-02abebabc9d4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:12.962722 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-48928599-2f5f-4fb1-b3f6-02abebabc9d4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.169167 Aug 26 18:29:12.963314 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 414/812] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:12 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:13.464215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4b8765e6-81bd-46d6-ab4b-345ca6bccef1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:13.464948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4b8765e6-81bd-46d6-ab4b-345ca6bccef1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:13.471752 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b8765e6-81bd-46d6-ab4b-345ca6bccef1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:13.472238 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b8765e6-81bd-46d6-ab4b-345ca6bccef1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:13.472731 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b8765e6-81bd-46d6-ab4b-345ca6bccef1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:13.473573 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b8765e6-81bd-46d6-ab4b-345ca6bccef1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:13.474033 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b8765e6-81bd-46d6-ab4b-345ca6bccef1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:13.474452 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b8765e6-81bd-46d6-ab4b-345ca6bccef1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:13.617935 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-4b8765e6-81bd-46d6-ab4b-345ca6bccef1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:13.626710 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4b8765e6-81bd-46d6-ab4b-345ca6bccef1 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1267 microversion: 2.1 time: 0.167114 Aug 26 18:29:13.627315 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 399/813] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:13 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:13.985444 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ba384ce2-d88e-4ec7-8c7b-9880550c67af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:13.986635 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ba384ce2-d88e-4ec7-8c7b-9880550c67af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:13.994352 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba384ce2-d88e-4ec7-8c7b-9880550c67af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:13.994934 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba384ce2-d88e-4ec7-8c7b-9880550c67af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:13.995386 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba384ce2-d88e-4ec7-8c7b-9880550c67af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:13.996444 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba384ce2-d88e-4ec7-8c7b-9880550c67af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:13.997228 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba384ce2-d88e-4ec7-8c7b-9880550c67af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:13.997778 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba384ce2-d88e-4ec7-8c7b-9880550c67af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:14.136699 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ba384ce2-d88e-4ec7-8c7b-9880550c67af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:14.144992 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ba384ce2-d88e-4ec7-8c7b-9880550c67af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:14.146466 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ba384ce2-d88e-4ec7-8c7b-9880550c67af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:14.147617 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ba384ce2-d88e-4ec7-8c7b-9880550c67af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.166057 Aug 26 18:29:14.148163 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 415/814] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:13 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:14.648055 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1fa106ba-e76d-44f3-a1f7-2273f0b6ab51 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:14.648758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1fa106ba-e76d-44f3-a1f7-2273f0b6ab51 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:14.655963 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1fa106ba-e76d-44f3-a1f7-2273f0b6ab51 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:14.656444 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1fa106ba-e76d-44f3-a1f7-2273f0b6ab51 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:14.656937 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1fa106ba-e76d-44f3-a1f7-2273f0b6ab51 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:14.657647 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1fa106ba-e76d-44f3-a1f7-2273f0b6ab51 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:14.658122 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1fa106ba-e76d-44f3-a1f7-2273f0b6ab51 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:14.658539 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1fa106ba-e76d-44f3-a1f7-2273f0b6ab51 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:14.800173 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1fa106ba-e76d-44f3-a1f7-2273f0b6ab51 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:14.803861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=100 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:14.808658 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1fa106ba-e76d-44f3-a1f7-2273f0b6ab51 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1455 microversion: 2.1 time: 0.164970 Aug 26 18:29:14.809333 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 400/815] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:14 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1455 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:14.829238 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b7bb973b-b31a-4e52-a849-50633209fe26 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:14.829853 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b7bb973b-b31a-4e52-a849-50633209fe26 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:14.836281 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7bb973b-b31a-4e52-a849-50633209fe26 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:14.846173 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7bb973b-b31a-4e52-a849-50633209fe26 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:14.846643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7bb973b-b31a-4e52-a849-50633209fe26 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:14.847422 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7bb973b-b31a-4e52-a849-50633209fe26 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:14.847874 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7bb973b-b31a-4e52-a849-50633209fe26 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:14.848361 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7bb973b-b31a-4e52-a849-50633209fe26 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:14.993400 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b7bb973b-b31a-4e52-a849-50633209fe26 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:15.003805 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b7bb973b-b31a-4e52-a849-50633209fe26 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1455 microversion: 2.1 time: 0.178574 Aug 26 18:29:15.004437 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 416/816] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:14 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1455 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:15.171918 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0da35582-5fac-41ae-8e15-e05523fad95a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:15.172517 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-0da35582-5fac-41ae-8e15-e05523fad95a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:15.178946 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0da35582-5fac-41ae-8e15-e05523fad95a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:15.179684 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0da35582-5fac-41ae-8e15-e05523fad95a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:15.180325 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0da35582-5fac-41ae-8e15-e05523fad95a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:15.181228 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0da35582-5fac-41ae-8e15-e05523fad95a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:15.181837 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0da35582-5fac-41ae-8e15-e05523fad95a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:15.182312 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0da35582-5fac-41ae-8e15-e05523fad95a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:15.324302 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0da35582-5fac-41ae-8e15-e05523fad95a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:15.333344 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0da35582-5fac-41ae-8e15-e05523fad95a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:15.334769 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0da35582-5fac-41ae-8e15-e05523fad95a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:15.336134 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-0da35582-5fac-41ae-8e15-e05523fad95a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.168956 Aug 26 18:29:15.337229 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 401/817] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:15 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:16.359388 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-80f29045-6d41-4cb5-832a-db8890f36551 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:16.359991 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-80f29045-6d41-4cb5-832a-db8890f36551 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:16.367788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80f29045-6d41-4cb5-832a-db8890f36551 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:16.368556 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80f29045-6d41-4cb5-832a-db8890f36551 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:16.369013 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80f29045-6d41-4cb5-832a-db8890f36551 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:16.369723 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80f29045-6d41-4cb5-832a-db8890f36551 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:16.370353 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80f29045-6d41-4cb5-832a-db8890f36551 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:16.370989 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80f29045-6d41-4cb5-832a-db8890f36551 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:16.734219 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-80f29045-6d41-4cb5-832a-db8890f36551 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:16.742654 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-80f29045-6d41-4cb5-832a-db8890f36551 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:16.744084 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-80f29045-6d41-4cb5-832a-db8890f36551 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:16.745358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-80f29045-6d41-4cb5-832a-db8890f36551 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.390223 Aug 26 18:29:16.745877 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 417/818] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:16 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:17.214923 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-8366bc44-9268-4d00-868c-a6022030fb31 req-675d2518-d1c9-4865-9dae-eefd0d79b44c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af8ec60-dd9a-4455-b357-74fa237e37ee", "tag": "e7d8dd42-ffb0-4122-a71f-c660208d6944"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:17.224855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-8366bc44-9268-4d00-868c-a6022030fb31 req-675d2518-d1c9-4865-9dae-eefd0d79b44c service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:17.225585 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-8366bc44-9268-4d00-868c-a6022030fb31 req-675d2518-d1c9-4865-9dae-eefd0d79b44c service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:17.226007 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-8366bc44-9268-4d00-868c-a6022030fb31 req-675d2518-d1c9-4865-9dae-eefd0d79b44c service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:17.238216 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-8366bc44-9268-4d00-868c-a6022030fb31 req-675d2518-d1c9-4865-9dae-eefd0d79b44c service nova] Creating event network-changed:e7d8dd42-ffb0-4122-a71f-c660208d6944 for instance 9af8ec60-dd9a-4455-b357-74fa237e37ee on hv-cinder-85199 Aug 26 18:29:17.244146 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-8366bc44-9268-4d00-868c-a6022030fb31 req-675d2518-d1c9-4865-9dae-eefd0d79b44c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179542 Aug 26 18:29:17.245733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 402/819] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:29:17.767976 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7e58926d-49ce-4623-be83-35e13302141a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:17.768753 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7e58926d-49ce-4623-be83-35e13302141a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:17.775784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e58926d-49ce-4623-be83-35e13302141a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:17.776268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e58926d-49ce-4623-be83-35e13302141a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:17.777218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e58926d-49ce-4623-be83-35e13302141a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:17.778116 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e58926d-49ce-4623-be83-35e13302141a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:17.778572 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e58926d-49ce-4623-be83-35e13302141a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:17.779135 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e58926d-49ce-4623-be83-35e13302141a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:17.917788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7e58926d-49ce-4623-be83-35e13302141a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:17.926398 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7e58926d-49ce-4623-be83-35e13302141a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:17.927927 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7e58926d-49ce-4623-be83-35e13302141a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:17.929144 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7e58926d-49ce-4623-be83-35e13302141a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.165159 Aug 26 18:29:17.929711 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 418/820] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:17 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:18.952604 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9372c599-47d8-494d-b823-780482137a49 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:18.953316 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9372c599-47d8-494d-b823-780482137a49 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:18.960265 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9372c599-47d8-494d-b823-780482137a49 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:18.960741 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9372c599-47d8-494d-b823-780482137a49 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:18.961208 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9372c599-47d8-494d-b823-780482137a49 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:18.961898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9372c599-47d8-494d-b823-780482137a49 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:18.962341 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9372c599-47d8-494d-b823-780482137a49 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:18.962756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9372c599-47d8-494d-b823-780482137a49 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:19.098353 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9372c599-47d8-494d-b823-780482137a49 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:19.106952 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9372c599-47d8-494d-b823-780482137a49 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:19.108374 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9372c599-47d8-494d-b823-780482137a49 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:19.109551 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9372c599-47d8-494d-b823-780482137a49 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.161730 Aug 26 18:29:19.110099 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 403/821] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:18 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:20.133990 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8a273950-381e-4325-8dca-810a4eed5286 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:20.134640 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8a273950-381e-4325-8dca-810a4eed5286 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:20.141782 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a273950-381e-4325-8dca-810a4eed5286 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:20.142265 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a273950-381e-4325-8dca-810a4eed5286 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:20.142694 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a273950-381e-4325-8dca-810a4eed5286 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:20.143394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a273950-381e-4325-8dca-810a4eed5286 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:20.143836 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a273950-381e-4325-8dca-810a4eed5286 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:20.144260 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a273950-381e-4325-8dca-810a4eed5286 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:20.280907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8a273950-381e-4325-8dca-810a4eed5286 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:20.290123 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8a273950-381e-4325-8dca-810a4eed5286 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:20.291598 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8a273950-381e-4325-8dca-810a4eed5286 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:20.292846 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8a273950-381e-4325-8dca-810a4eed5286 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.163388 Aug 26 18:29:20.293427 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 419/822] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:20 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:21.316246 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0c633395-0212-4d88-84f3-f2ef0b1012b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:21.316909 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-0c633395-0212-4d88-84f3-f2ef0b1012b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:21.325066 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0c633395-0212-4d88-84f3-f2ef0b1012b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:21.325548 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0c633395-0212-4d88-84f3-f2ef0b1012b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:21.325975 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0c633395-0212-4d88-84f3-f2ef0b1012b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:21.326667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0c633395-0212-4d88-84f3-f2ef0b1012b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:21.327118 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0c633395-0212-4d88-84f3-f2ef0b1012b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:21.327538 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0c633395-0212-4d88-84f3-f2ef0b1012b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:21.465026 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0c633395-0212-4d88-84f3-f2ef0b1012b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:21.481806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0c633395-0212-4d88-84f3-f2ef0b1012b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:21.483238 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0c633395-0212-4d88-84f3-f2ef0b1012b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:21.484407 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-0c633395-0212-4d88-84f3-f2ef0b1012b9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.172307 Aug 26 18:29:21.484991 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 404/823] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:21 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:22.271334 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2a790a75-7169-4cfb-902b-bd5c62776160 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:22.271994 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2a790a75-7169-4cfb-902b-bd5c62776160 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:22.274352 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:22.281137 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a790a75-7169-4cfb-902b-bd5c62776160 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:22.281615 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a790a75-7169-4cfb-902b-bd5c62776160 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:22.282045 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a790a75-7169-4cfb-902b-bd5c62776160 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:22.282727 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a790a75-7169-4cfb-902b-bd5c62776160 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:22.283168 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a790a75-7169-4cfb-902b-bd5c62776160 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:22.283582 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a790a75-7169-4cfb-902b-bd5c62776160 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:22.308065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2a790a75-7169-4cfb-902b-bd5c62776160 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7/ips" status: 200 len: 149 microversion: 2.1 time: 0.040778 Aug 26 18:29:22.308627 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 420/824] 10.222.0.45 () {58 vars in 1248 bytes} [Fri Aug 26 18:29:22 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:29:22.508247 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-01abfbe2-50eb-4feb-a6f4-e4b5243aee22 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:22.508870 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-01abfbe2-50eb-4feb-a6f4-e4b5243aee22 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:22.516197 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-01abfbe2-50eb-4feb-a6f4-e4b5243aee22 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:22.516697 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-01abfbe2-50eb-4feb-a6f4-e4b5243aee22 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:22.517337 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-01abfbe2-50eb-4feb-a6f4-e4b5243aee22 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:22.518083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-01abfbe2-50eb-4feb-a6f4-e4b5243aee22 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:22.518505 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-01abfbe2-50eb-4feb-a6f4-e4b5243aee22 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:22.518924 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-01abfbe2-50eb-4feb-a6f4-e4b5243aee22 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:22.677698 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-01abfbe2-50eb-4feb-a6f4-e4b5243aee22 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:22.689910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-01abfbe2-50eb-4feb-a6f4-e4b5243aee22 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:22.692248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-01abfbe2-50eb-4feb-a6f4-e4b5243aee22 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:22.693753 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-01abfbe2-50eb-4feb-a6f4-e4b5243aee22 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.190250 Aug 26 18:29:22.694320 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 405/825] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:22 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:23.693730 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0fe59fa4-3b69-4998-ba3b-566824383ac9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f52df57-6559-459b-9c7b-23609c267cb8"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:23.696258 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0fe59fa4-3b69-4998-ba3b-566824383ac9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:23.703028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fe59fa4-3b69-4998-ba3b-566824383ac9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:23.703507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fe59fa4-3b69-4998-ba3b-566824383ac9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:23.703945 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fe59fa4-3b69-4998-ba3b-566824383ac9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:23.704628 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fe59fa4-3b69-4998-ba3b-566824383ac9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:23.705103 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fe59fa4-3b69-4998-ba3b-566824383ac9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:23.705554 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fe59fa4-3b69-4998-ba3b-566824383ac9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:23.717058 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d71bed8d-53ff-4b68-bc3c-313f6c62949e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:23.717687 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-d71bed8d-53ff-4b68-bc3c-313f6c62949e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:23.724873 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d71bed8d-53ff-4b68-bc3c-313f6c62949e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:23.725362 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d71bed8d-53ff-4b68-bc3c-313f6c62949e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:23.726010 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d71bed8d-53ff-4b68-bc3c-313f6c62949e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:23.726733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d71bed8d-53ff-4b68-bc3c-313f6c62949e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:23.727195 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d71bed8d-53ff-4b68-bc3c-313f6c62949e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:23.727630 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d71bed8d-53ff-4b68-bc3c-313f6c62949e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:23.842622 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:23.875211 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d71bed8d-53ff-4b68-bc3c-313f6c62949e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:23.885219 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d71bed8d-53ff-4b68-bc3c-313f6c62949e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:23.887060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d71bed8d-53ff-4b68-bc3c-313f6c62949e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:23.888214 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-d71bed8d-53ff-4b68-bc3c-313f6c62949e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.175140 Aug 26 18:29:23.889025 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 406/826] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:23 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:23.964147 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0fe59fa4-3b69-4998-ba3b-566824383ac9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "POST /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274398 Aug 26 18:29:23.964903 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 421/827] 10.222.0.45 () {60 vars in 1323 bytes} [Fri Aug 26 18:29:23 2022] POST /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:29:24.912459 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8b4da324-9f43-42ec-8385-c79200c459f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:24.913263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8b4da324-9f43-42ec-8385-c79200c459f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:24.919967 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8b4da324-9f43-42ec-8385-c79200c459f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:24.920527 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8b4da324-9f43-42ec-8385-c79200c459f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:24.921083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8b4da324-9f43-42ec-8385-c79200c459f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:24.921864 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8b4da324-9f43-42ec-8385-c79200c459f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:24.922381 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8b4da324-9f43-42ec-8385-c79200c459f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:24.922851 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8b4da324-9f43-42ec-8385-c79200c459f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:25.065054 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8b4da324-9f43-42ec-8385-c79200c459f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:25.074965 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8b4da324-9f43-42ec-8385-c79200c459f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:25.077347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8b4da324-9f43-42ec-8385-c79200c459f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:25.079064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8b4da324-9f43-42ec-8385-c79200c459f9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.170640 Aug 26 18:29:25.080346 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 407/828] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:24 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:26.104950 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-486fec43-355a-4bf0-8c7b-b68f0ea9cd52 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:26.106203 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-486fec43-355a-4bf0-8c7b-b68f0ea9cd52 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:26.112618 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-486fec43-355a-4bf0-8c7b-b68f0ea9cd52 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:26.113375 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-486fec43-355a-4bf0-8c7b-b68f0ea9cd52 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:26.114128 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-486fec43-355a-4bf0-8c7b-b68f0ea9cd52 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:26.115000 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-486fec43-355a-4bf0-8c7b-b68f0ea9cd52 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:26.115684 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-486fec43-355a-4bf0-8c7b-b68f0ea9cd52 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:26.116259 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-486fec43-355a-4bf0-8c7b-b68f0ea9cd52 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:26.261119 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-486fec43-355a-4bf0-8c7b-b68f0ea9cd52 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:26.264562 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-486fec43-355a-4bf0-8c7b-b68f0ea9cd52 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:26.266130 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-486fec43-355a-4bf0-8c7b-b68f0ea9cd52 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:26.267348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-486fec43-355a-4bf0-8c7b-b68f0ea9cd52 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.167342 Aug 26 18:29:26.267890 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 422/829] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:26 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:27.291698 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-bfccfa01-40b2-42b9-823a-e2bae1848a25 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:27.292307 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-bfccfa01-40b2-42b9-823a-e2bae1848a25 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:27.298338 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bfccfa01-40b2-42b9-823a-e2bae1848a25 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:27.298819 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bfccfa01-40b2-42b9-823a-e2bae1848a25 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:27.299244 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bfccfa01-40b2-42b9-823a-e2bae1848a25 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:27.299935 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bfccfa01-40b2-42b9-823a-e2bae1848a25 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:27.300381 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bfccfa01-40b2-42b9-823a-e2bae1848a25 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:27.300821 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bfccfa01-40b2-42b9-823a-e2bae1848a25 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:27.702774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-bfccfa01-40b2-42b9-823a-e2bae1848a25 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:27.711254 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-bfccfa01-40b2-42b9-823a-e2bae1848a25 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:27.712670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-bfccfa01-40b2-42b9-823a-e2bae1848a25 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:27.713846 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-bfccfa01-40b2-42b9-823a-e2bae1848a25 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1744 microversion: 2.20 time: 0.426819 Aug 26 18:29:27.714430 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 408/830] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:27 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1744 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:28.736460 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bcb58281-ffaa-4028-a1d7-49f3decd3065 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:28.737267 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bcb58281-ffaa-4028-a1d7-49f3decd3065 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:28.745449 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bcb58281-ffaa-4028-a1d7-49f3decd3065 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:28.745859 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bcb58281-ffaa-4028-a1d7-49f3decd3065 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:28.746600 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bcb58281-ffaa-4028-a1d7-49f3decd3065 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:28.747385 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bcb58281-ffaa-4028-a1d7-49f3decd3065 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:28.748054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bcb58281-ffaa-4028-a1d7-49f3decd3065 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:28.748666 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bcb58281-ffaa-4028-a1d7-49f3decd3065 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:28.898687 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bcb58281-ffaa-4028-a1d7-49f3decd3065 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:28.908621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bcb58281-ffaa-4028-a1d7-49f3decd3065 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:28.910368 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bcb58281-ffaa-4028-a1d7-49f3decd3065 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:28.912128 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bcb58281-ffaa-4028-a1d7-49f3decd3065 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1744 microversion: 2.20 time: 0.179506 Aug 26 18:29:28.912831 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 423/831] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:28 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:29.935345 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-6d81042a-fa0d-4ad5-b75e-a155435e0a53 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:29.936044 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-6d81042a-fa0d-4ad5-b75e-a155435e0a53 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:29.944167 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d81042a-fa0d-4ad5-b75e-a155435e0a53 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:29.945014 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d81042a-fa0d-4ad5-b75e-a155435e0a53 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:29.945655 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d81042a-fa0d-4ad5-b75e-a155435e0a53 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:29.946625 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d81042a-fa0d-4ad5-b75e-a155435e0a53 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:29.947070 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d81042a-fa0d-4ad5-b75e-a155435e0a53 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:29.947688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-6d81042a-fa0d-4ad5-b75e-a155435e0a53 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:30.095791 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6d81042a-fa0d-4ad5-b75e-a155435e0a53 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:30.105846 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6d81042a-fa0d-4ad5-b75e-a155435e0a53 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:30.107563 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-6d81042a-fa0d-4ad5-b75e-a155435e0a53 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:30.109145 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-6d81042a-fa0d-4ad5-b75e-a155435e0a53 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1739 microversion: 2.20 time: 0.177813 Aug 26 18:29:30.109891 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 409/832] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:29 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:30.636827 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4e10cc5c-7a84-43ea-b726-070574154a4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f52df57-6559-459b-9c7b-23609c267cb8"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:30.639562 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4e10cc5c-7a84-43ea-b726-070574154a4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:30.648650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e10cc5c-7a84-43ea-b726-070574154a4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:30.649257 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e10cc5c-7a84-43ea-b726-070574154a4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:30.649895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e10cc5c-7a84-43ea-b726-070574154a4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:30.650612 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e10cc5c-7a84-43ea-b726-070574154a4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:30.651233 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e10cc5c-7a84-43ea-b726-070574154a4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:30.651809 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e10cc5c-7a84-43ea-b726-070574154a4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:30.757248 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-4e10cc5c-7a84-43ea-b726-070574154a4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] HTTP exception thrown: Invalid volume: volume 3f52df57-6559-459b-9c7b-23609c267cb8 is already attached to instances: 4cbde000-0844-4305-9309-31a6e53167a7 Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4e10cc5c-7a84-43ea-b726-070574154a4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Request method failure captured: Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: POST /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7/os-volume_attachments HTTP/1.1 Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 74 Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ_7WV4eHbAqOpnTYkwFP6-jB3HCDjeZbl0R247dr5RR1y2TCZ3q7yJc3wAkX4naY95SpgiF97bav2cRanoMnEaxUU8VKQlnKSHzILsN-blIL91h5HmfvqVCwXlIyEUHdZjNlc9SaFqhXfX303L2e3MPsBKCAHoO-gSYEI6n3TQjqMw Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:29:30.759138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:29:30.760926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_67f4fd75428040ab9ff8a0458e4708fb", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/67f4fd75428040ab9ff8a0458e4708fb"}]}] Aug 26 18:29:30.760926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:29:30.760926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:29:30.760926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:29:30.760926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:29:30.760926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:29:30.760926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:29:30.760926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: a1be02f9e7fd4bdabc05ec48e2a35f56 Aug 26 18:29:30.760926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:29:30.760926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Aug 26 18:29:30.760926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {"volumeAttachment": {"volumeId": "3f52df57-6559-459b-9c7b-23609c267cb8"}} Aug 26 18:29:30.760926 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Invalid volume: volume 3f52df57-6559-459b-9c7b-23609c267cb8 is already attached to instances: 4cbde000-0844-4305-9309-31a6e53167a7 Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'server_id': '4cbde000-0844-4305-9309-31a6e53167a7', 'body': {'volumeAttachment': {'volumeId': '3f52df57-6559-459b-9c7b-23609c267cb8'}}} Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3f52df57-6559-459b-9c7b-23609c267cb8 is already attached to instances: 4cbde000-0844-4305-9309-31a6e53167a7 Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:29:30.761901 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3f52df57-6559-459b-9c7b-23609c267cb8 is already attached to instances: 4cbde000-0844-4305-9309-31a6e53167a7 Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:29:30.765972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:29:30.769958 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:29:30.769958 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:29:30.769958 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:29:30.769958 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3f52df57-6559-459b-9c7b-23609c267cb8 is already attached to instances: 4cbde000-0844-4305-9309-31a6e53167a7 Aug 26 18:29:30.769958 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:29:30.769958 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4e10cc5c-7a84-43ea-b726-070574154a4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Returning 400 to user: Invalid volume: volume 3f52df57-6559-459b-9c7b-23609c267cb8 is already attached to instances: 4cbde000-0844-4305-9309-31a6e53167a7 {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:29:30.769958 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4e10cc5c-7a84-43ea-b726-070574154a4e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "POST /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.131970 Aug 26 18:29:30.782621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 424/833] 10.222.0.45 () {60 vars in 1323 bytes} [Fri Aug 26 18:29:30 2022] POST /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7/os-volume_attachments => generated 174 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 18:29:30.860220 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6653f81c-c5c1-4098-a4cc-d8f8886445a1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:30.860747 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6653f81c-c5c1-4098-a4cc-d8f8886445a1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:30.870993 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6653f81c-c5c1-4098-a4cc-d8f8886445a1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:30.871487 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6653f81c-c5c1-4098-a4cc-d8f8886445a1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:30.871983 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6653f81c-c5c1-4098-a4cc-d8f8886445a1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:30.872753 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6653f81c-c5c1-4098-a4cc-d8f8886445a1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:30.883224 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6653f81c-c5c1-4098-a4cc-d8f8886445a1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:30.883643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6653f81c-c5c1-4098-a4cc-d8f8886445a1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:30.976784 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-98d95ae4-84af-4add-961b-946ec2f0019e req-1aef579e-315a-437a-b6b2-4c40e6858c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82d25b8-bf09-48ca-9098-20bff440e163", "name": "network-vif-plugged", "status": "completed", "tag": "9120b3ad-b9e1-459d-b90c-56a0a48c2f3d"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:30.985793 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-6653f81c-c5c1-4098-a4cc-d8f8886445a1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lazy-loading 'services' on Instance uuid 4cbde000-0844-4305-9309-31a6e53167a7 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:29:30.988221 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-98d95ae4-84af-4add-961b-946ec2f0019e req-1aef579e-315a-437a-b6b2-4c40e6858c8b service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:30.988897 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-98d95ae4-84af-4add-961b-946ec2f0019e req-1aef579e-315a-437a-b6b2-4c40e6858c8b service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:30.989539 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-98d95ae4-84af-4add-961b-946ec2f0019e req-1aef579e-315a-437a-b6b2-4c40e6858c8b service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:31.005144 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-98d95ae4-84af-4add-961b-946ec2f0019e req-1aef579e-315a-437a-b6b2-4c40e6858c8b service nova] Creating event network-vif-plugged:9120b3ad-b9e1-459d-b90c-56a0a48c2f3d for instance f82d25b8-bf09-48ca-9098-20bff440e163 on hv-cinder-85199 Aug 26 18:29:31.011588 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-98d95ae4-84af-4add-961b-946ec2f0019e req-1aef579e-315a-437a-b6b2-4c40e6858c8b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274613 Aug 26 18:29:31.017354 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 410/834] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:29:31.088646 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6653f81c-c5c1-4098-a4cc-d8f8886445a1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7/os-volume_attachments/3f52df57-6559-459b-9c7b-23609c267cb8" status: 202 len: 0 microversion: 2.1 time: 0.232528 Aug 26 18:29:31.089416 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 425/835] 10.222.0.45 () {58 vars in 1416 bytes} [Fri Aug 26 18:29:30 2022] DELETE /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7/os-volume_attachments/3f52df57-6559-459b-9c7b-23609c267cb8 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 18:29:31.102802 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-5de6680b-c7d5-4d81-b998-78639b026557 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:31.105822 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-5de6680b-c7d5-4d81-b998-78639b026557 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:31.113262 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5de6680b-c7d5-4d81-b998-78639b026557 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:31.114054 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5de6680b-c7d5-4d81-b998-78639b026557 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:31.114830 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5de6680b-c7d5-4d81-b998-78639b026557 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:31.115923 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5de6680b-c7d5-4d81-b998-78639b026557 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:31.116666 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5de6680b-c7d5-4d81-b998-78639b026557 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:31.117356 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5de6680b-c7d5-4d81-b998-78639b026557 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:31.139798 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-77765fc8-96f2-46a2-a4f3-6713fdb81915 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:31.140448 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-77765fc8-96f2-46a2-a4f3-6713fdb81915 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:31.161995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-5de6680b-c7d5-4d81-b998-78639b026557 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066385 Aug 26 18:29:31.162449 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77765fc8-96f2-46a2-a4f3-6713fdb81915 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:31.162956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77765fc8-96f2-46a2-a4f3-6713fdb81915 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:31.163420 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 411/836] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:29:31 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:29:31.165988 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77765fc8-96f2-46a2-a4f3-6713fdb81915 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:31.166824 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77765fc8-96f2-46a2-a4f3-6713fdb81915 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:31.167471 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77765fc8-96f2-46a2-a4f3-6713fdb81915 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:31.167906 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77765fc8-96f2-46a2-a4f3-6713fdb81915 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:31.369839 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-77765fc8-96f2-46a2-a4f3-6713fdb81915 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:31.379303 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-77765fc8-96f2-46a2-a4f3-6713fdb81915 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:31.381490 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-77765fc8-96f2-46a2-a4f3-6713fdb81915 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:31.383232 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-77765fc8-96f2-46a2-a4f3-6713fdb81915 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1739 microversion: 2.20 time: 0.250686 Aug 26 18:29:31.395348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 426/837] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:31 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:32.174953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-557cac49-db1a-4903-95cc-b5f93273b224 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:32.177547 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-557cac49-db1a-4903-95cc-b5f93273b224 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:32.191188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-557cac49-db1a-4903-95cc-b5f93273b224 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:32.191881 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-557cac49-db1a-4903-95cc-b5f93273b224 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:32.192457 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-557cac49-db1a-4903-95cc-b5f93273b224 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:32.193383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-557cac49-db1a-4903-95cc-b5f93273b224 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:32.193959 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-557cac49-db1a-4903-95cc-b5f93273b224 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:32.194609 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-557cac49-db1a-4903-95cc-b5f93273b224 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:32.231279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-557cac49-db1a-4903-95cc-b5f93273b224 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060183 Aug 26 18:29:32.231955 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 412/838] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:29:32 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 18:29:32.334553 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab830af1-6040-4a99-bc38-d04212354141 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:32.335748 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ab830af1-6040-4a99-bc38-d04212354141 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:32.344493 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab830af1-6040-4a99-bc38-d04212354141 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:32.345304 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab830af1-6040-4a99-bc38-d04212354141 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:32.345905 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab830af1-6040-4a99-bc38-d04212354141 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:32.347323 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab830af1-6040-4a99-bc38-d04212354141 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:32.347946 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab830af1-6040-4a99-bc38-d04212354141 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:32.348553 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab830af1-6040-4a99-bc38-d04212354141 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:32.386886 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ab830af1-6040-4a99-bc38-d04212354141 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:29:32.411163 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9817cf61-acf5-43ca-bb5c-df13ac0b6ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:32.411846 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9817cf61-acf5-43ca-bb5c-df13ac0b6ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:32.429784 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9817cf61-acf5-43ca-bb5c-df13ac0b6ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:32.430303 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9817cf61-acf5-43ca-bb5c-df13ac0b6ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:32.430740 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9817cf61-acf5-43ca-bb5c-df13ac0b6ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:32.431491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9817cf61-acf5-43ca-bb5c-df13ac0b6ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:32.431972 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9817cf61-acf5-43ca-bb5c-df13ac0b6ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:32.432396 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9817cf61-acf5-43ca-bb5c-df13ac0b6ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:32.532463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ab830af1-6040-4a99-bc38-d04212354141 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 204 len: 0 microversion: 2.1 time: 0.202495 Aug 26 18:29:32.535068 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 427/839] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:29:32 2022] DELETE /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:29:32.545838 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-02f49728-8823-42f8-b2f5-e4700ad01f4f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:32.546905 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-02f49728-8823-42f8-b2f5-e4700ad01f4f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:32.553659 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02f49728-8823-42f8-b2f5-e4700ad01f4f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:32.554869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02f49728-8823-42f8-b2f5-e4700ad01f4f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:32.555580 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02f49728-8823-42f8-b2f5-e4700ad01f4f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:32.556669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02f49728-8823-42f8-b2f5-e4700ad01f4f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:32.557392 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02f49728-8823-42f8-b2f5-e4700ad01f4f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:32.558027 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02f49728-8823-42f8-b2f5-e4700ad01f4f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:32.624278 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9817cf61-acf5-43ca-bb5c-df13ac0b6ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:32.636113 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9817cf61-acf5-43ca-bb5c-df13ac0b6ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:32.637989 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9817cf61-acf5-43ca-bb5c-df13ac0b6ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:32.639440 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9817cf61-acf5-43ca-bb5c-df13ac0b6ccd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1739 microversion: 2.20 time: 0.235642 Aug 26 18:29:32.640486 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 413/840] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:32 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:29:32.731793 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-02f49728-8823-42f8-b2f5-e4700ad01f4f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:32.739894 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-02f49728-8823-42f8-b2f5-e4700ad01f4f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1681 microversion: 2.1 time: 0.198431 Aug 26 18:29:32.740559 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 428/841] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:32 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:33.664373 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-24179753-628d-41f7-bd88-eee5494e5fbc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:33.665264 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-24179753-628d-41f7-bd88-eee5494e5fbc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:33.677555 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-24179753-628d-41f7-bd88-eee5494e5fbc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:33.678100 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-24179753-628d-41f7-bd88-eee5494e5fbc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:33.678541 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-24179753-628d-41f7-bd88-eee5494e5fbc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:33.679334 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-24179753-628d-41f7-bd88-eee5494e5fbc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:33.679765 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-24179753-628d-41f7-bd88-eee5494e5fbc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:33.680192 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-24179753-628d-41f7-bd88-eee5494e5fbc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:33.764417 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-414e8a45-ba20-4209-9051-d02e5d71e48f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:33.765118 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-414e8a45-ba20-4209-9051-d02e5d71e48f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:33.773735 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-414e8a45-ba20-4209-9051-d02e5d71e48f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:33.774788 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-414e8a45-ba20-4209-9051-d02e5d71e48f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:33.775243 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-414e8a45-ba20-4209-9051-d02e5d71e48f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:33.776464 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-414e8a45-ba20-4209-9051-d02e5d71e48f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:33.777105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-414e8a45-ba20-4209-9051-d02e5d71e48f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:33.778037 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-414e8a45-ba20-4209-9051-d02e5d71e48f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:33.904640 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-24179753-628d-41f7-bd88-eee5494e5fbc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:33.915750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-24179753-628d-41f7-bd88-eee5494e5fbc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:33.917706 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-24179753-628d-41f7-bd88-eee5494e5fbc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:33.920069 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-24179753-628d-41f7-bd88-eee5494e5fbc tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1739 microversion: 2.20 time: 0.259761 Aug 26 18:29:33.925000 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 414/842] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:33 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:33.963523 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-414e8a45-ba20-4209-9051-d02e5d71e48f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:33.975130 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-414e8a45-ba20-4209-9051-d02e5d71e48f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1681 microversion: 2.1 time: 0.215078 Aug 26 18:29:33.976202 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 429/843] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:33 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:29:34.949751 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-695bbc33-03b8-46a9-a288-14e45513c99e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:34.954581 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-695bbc33-03b8-46a9-a288-14e45513c99e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:34.963190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-695bbc33-03b8-46a9-a288-14e45513c99e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:34.963680 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-695bbc33-03b8-46a9-a288-14e45513c99e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:34.964299 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-695bbc33-03b8-46a9-a288-14e45513c99e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:34.965186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-695bbc33-03b8-46a9-a288-14e45513c99e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:34.965921 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-695bbc33-03b8-46a9-a288-14e45513c99e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:34.966499 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-695bbc33-03b8-46a9-a288-14e45513c99e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:35.003748 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c59e615a-e304-4c53-8391-d720644f5619 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:35.005003 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c59e615a-e304-4c53-8391-d720644f5619 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:35.039473 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c59e615a-e304-4c53-8391-d720644f5619 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:35.040604 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c59e615a-e304-4c53-8391-d720644f5619 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:35.041168 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c59e615a-e304-4c53-8391-d720644f5619 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:35.042158 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c59e615a-e304-4c53-8391-d720644f5619 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:35.042621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c59e615a-e304-4c53-8391-d720644f5619 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:35.043050 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c59e615a-e304-4c53-8391-d720644f5619 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:35.132388 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c59e615a-e304-4c53-8391-d720644f5619 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:35.141214 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c59e615a-e304-4c53-8391-d720644f5619 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1613 microversion: 2.1 time: 0.146753 Aug 26 18:29:35.142046 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 430/844] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:34 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1613 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:29:35.252607 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-695bbc33-03b8-46a9-a288-14e45513c99e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:35.264234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-695bbc33-03b8-46a9-a288-14e45513c99e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:35.266166 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-695bbc33-03b8-46a9-a288-14e45513c99e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:35.267639 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-695bbc33-03b8-46a9-a288-14e45513c99e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1739 microversion: 2.20 time: 0.322732 Aug 26 18:29:35.268493 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 415/845] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:34 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1739 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:35.522684 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-6982f1ee-50fb-45f1-8aee-1c9f50a062a8 req-0486e790-dd2f-4d18-ab49-911229af9a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbde000-0844-4305-9309-31a6e53167a7", "name": "network-vif-deleted", "tag": "be9a00ea-a696-4aaa-be11-b5198ea1bb36"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:35.550494 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-6982f1ee-50fb-45f1-8aee-1c9f50a062a8 req-0486e790-dd2f-4d18-ab49-911229af9a0d service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:35.551031 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-6982f1ee-50fb-45f1-8aee-1c9f50a062a8 req-0486e790-dd2f-4d18-ab49-911229af9a0d service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:35.551741 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-6982f1ee-50fb-45f1-8aee-1c9f50a062a8 req-0486e790-dd2f-4d18-ab49-911229af9a0d service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:35.581397 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-6982f1ee-50fb-45f1-8aee-1c9f50a062a8 req-0486e790-dd2f-4d18-ab49-911229af9a0d service nova] Creating event network-vif-deleted:be9a00ea-a696-4aaa-be11-b5198ea1bb36 for instance 4cbde000-0844-4305-9309-31a6e53167a7 on hv-cinder-85199 Aug 26 18:29:35.602276 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-6982f1ee-50fb-45f1-8aee-1c9f50a062a8 req-0486e790-dd2f-4d18-ab49-911229af9a0d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085519 Aug 26 18:29:35.604635 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 431/846] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:29:36.163739 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-533c487e-09ea-4c9b-bb4a-7027479ca5d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:36.164444 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-533c487e-09ea-4c9b-bb4a-7027479ca5d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:36.171269 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-533c487e-09ea-4c9b-bb4a-7027479ca5d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:36.171835 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-533c487e-09ea-4c9b-bb4a-7027479ca5d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:36.172279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-533c487e-09ea-4c9b-bb4a-7027479ca5d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:36.184796 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-533c487e-09ea-4c9b-bb4a-7027479ca5d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:36.184796 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-533c487e-09ea-4c9b-bb4a-7027479ca5d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:36.184796 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-533c487e-09ea-4c9b-bb4a-7027479ca5d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:36.237133 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-533c487e-09ea-4c9b-bb4a-7027479ca5d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:36.238539 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-533c487e-09ea-4c9b-bb4a-7027479ca5d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:36.239138 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-533c487e-09ea-4c9b-bb4a-7027479ca5d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:36.239751 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-533c487e-09ea-4c9b-bb4a-7027479ca5d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lazy-loading 'fault' on Instance uuid 4cbde000-0844-4305-9309-31a6e53167a7 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:29:36.290115 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-533c487e-09ea-4c9b-bb4a-7027479ca5d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:36.294397 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-46e7bd47-a53b-461e-90bc-cfe20b6c92e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:36.295668 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-46e7bd47-a53b-461e-90bc-cfe20b6c92e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:36.300947 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-533c487e-09ea-4c9b-bb4a-7027479ca5d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 200 len: 1331 microversion: 2.1 time: 0.141184 Aug 26 18:29:36.302525 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 416/847] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:36 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 1331 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:36.304360 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46e7bd47-a53b-461e-90bc-cfe20b6c92e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:36.305075 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46e7bd47-a53b-461e-90bc-cfe20b6c92e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:36.305516 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46e7bd47-a53b-461e-90bc-cfe20b6c92e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:36.306235 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46e7bd47-a53b-461e-90bc-cfe20b6c92e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:36.306688 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46e7bd47-a53b-461e-90bc-cfe20b6c92e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:36.307292 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46e7bd47-a53b-461e-90bc-cfe20b6c92e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:36.515803 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-46e7bd47-a53b-461e-90bc-cfe20b6c92e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:36.525627 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-46e7bd47-a53b-461e-90bc-cfe20b6c92e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:36.527429 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-46e7bd47-a53b-461e-90bc-cfe20b6c92e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:36.529298 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-46e7bd47-a53b-461e-90bc-cfe20b6c92e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1739 microversion: 2.20 time: 0.240890 Aug 26 18:29:36.545794 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 432/848] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:36 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1739 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:29:37.325340 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-46967cc0-d7ac-434e-928c-72760a86a769 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:37.326609 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-46967cc0-d7ac-434e-928c-72760a86a769 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:37.329411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=50 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:37.335257 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-46967cc0-d7ac-434e-928c-72760a86a769 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:37.335744 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-46967cc0-d7ac-434e-928c-72760a86a769 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:37.336177 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-46967cc0-d7ac-434e-928c-72760a86a769 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:37.337331 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-46967cc0-d7ac-434e-928c-72760a86a769 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:37.337956 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-46967cc0-d7ac-434e-928c-72760a86a769 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:37.338820 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-46967cc0-d7ac-434e-928c-72760a86a769 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:37.355164 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-46967cc0-d7ac-434e-928c-72760a86a769 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] HTTP exception thrown: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-46967cc0-d7ac-434e-928c-72760a86a769 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Request method failure captured: Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 HTTP/1.1 Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ_7WV4eHbAqOpnTYkwFP6-jB3HCDjeZbl0R247dr5RR1y2TCZ3q7yJc3wAkX4naY95SpgiF97bav2cRanoMnEaxUU8VKQlnKSHzILsN-blIL91h5HmfvqVCwXlIyEUHdZjNlc9SaFqhXfX303L2e3MPsBKCAHoO-gSYEI6n3TQjqMw Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:29:37.356884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:29:37.358218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_67f4fd75428040ab9ff8a0458e4708fb", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/67f4fd75428040ab9ff8a0458e4708fb"}]}] Aug 26 18:29:37.358218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:29:37.358218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:29:37.358218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:29:37.358218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:29:37.358218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:29:37.358218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:29:37.358218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: a1be02f9e7fd4bdabc05ec48e2a35f56 Aug 26 18:29:37.358218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:29:37.358218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:29:37.358218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. Aug 26 18:29:37.358218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '4cbde000-0844-4305-9309-31a6e53167a7'} Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:29:37.358995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. Aug 26 18:29:37.360248 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:29:37.363560 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-46967cc0-d7ac-434e-928c-72760a86a769 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Returning 404 to user: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:29:37.363560 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-46967cc0-d7ac-434e-928c-72760a86a769 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 404 len: 111 microversion: 2.1 time: 0.037926 Aug 26 18:29:37.363560 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 417/849] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:37 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:29:37.367320 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a69d9302-680b-4db0-99e4-c5900092acbf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '.version_select at 0x7fc747a704c0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:37.392644 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a69d9302-680b-4db0-99e4-c5900092acbf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-231341577" status: 202 len: 0 microversion: 2.1 time: 0.029012 Aug 26 18:29:37.394689 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 433/850] 10.222.0.45 () {58 vars in 1218 bytes} [Fri Aug 26 18:29:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-231341577 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:29:37.554093 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-3160e651-b7c0-430a-ad76-d66aa1d6187b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:37.554798 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-3160e651-b7c0-430a-ad76-d66aa1d6187b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:37.565711 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3160e651-b7c0-430a-ad76-d66aa1d6187b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:37.570510 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3160e651-b7c0-430a-ad76-d66aa1d6187b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:37.571230 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3160e651-b7c0-430a-ad76-d66aa1d6187b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:37.572360 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3160e651-b7c0-430a-ad76-d66aa1d6187b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:37.573073 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3160e651-b7c0-430a-ad76-d66aa1d6187b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:37.573763 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3160e651-b7c0-430a-ad76-d66aa1d6187b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:37.746237 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3160e651-b7c0-430a-ad76-d66aa1d6187b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:37.757132 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3160e651-b7c0-430a-ad76-d66aa1d6187b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:37.758978 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3160e651-b7c0-430a-ad76-d66aa1d6187b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:37.760769 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-3160e651-b7c0-430a-ad76-d66aa1d6187b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1739 microversion: 2.20 time: 0.210997 Aug 26 18:29:37.778301 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 418/851] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:37 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:38.309789 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-92133982-18de-47d8-969f-3bf4162f309a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Action: 'create', calling method: .version_select at 0x7fc7440d84c0>, body: {"keypair": {"name": "tempest-keypair-1874891470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnSWov40uUIDOVj84pmN2q6QZX9HU8o88WDxAmqO9qsRuyy2tAexs1uzlPdvLk96uZHOGRtsq38rloNDkiiEcVxMhaDKktzP9SxtHe87pVk4CumIUvzM7gFLPsYYxh0uA=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:38.331003 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-92133982-18de-47d8-969f-3bf4162f309a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:29:38.341059 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-92133982-18de-47d8-969f-3bf4162f309a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for user a1be02f9e7fd4bdabc05ec48e2a35f56 and project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:29:38.378950 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-92133982-18de-47d8-969f-3bf4162f309a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074336 Aug 26 18:29:38.380949 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 434/852] 10.222.0.45 () {60 vars in 1159 bytes} [Fri Aug 26 18:29:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:29:38.784865 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-50e343f5-0c6b-40fb-a21c-bd5ce759ac14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:38.785408 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-50e343f5-0c6b-40fb-a21c-bd5ce759ac14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:38.793099 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-50e343f5-0c6b-40fb-a21c-bd5ce759ac14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:38.793891 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-50e343f5-0c6b-40fb-a21c-bd5ce759ac14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:38.794480 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-50e343f5-0c6b-40fb-a21c-bd5ce759ac14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:38.795378 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-50e343f5-0c6b-40fb-a21c-bd5ce759ac14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:38.795989 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-50e343f5-0c6b-40fb-a21c-bd5ce759ac14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:38.796571 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-50e343f5-0c6b-40fb-a21c-bd5ce759ac14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:38.801540 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=100 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:39.066041 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-50e343f5-0c6b-40fb-a21c-bd5ce759ac14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:39.101202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-50e343f5-0c6b-40fb-a21c-bd5ce759ac14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:39.108744 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-50e343f5-0c6b-40fb-a21c-bd5ce759ac14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:39.113093 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-50e343f5-0c6b-40fb-a21c-bd5ce759ac14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1739 microversion: 2.20 time: 0.332753 Aug 26 18:29:39.116300 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 419/853] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:38 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:39.381418 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-194129c0-f0b9-434e-89f9-4dc3f76a6ed2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:39.382505 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-194129c0-f0b9-434e-89f9-4dc3f76a6ed2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:39.398540 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-194129c0-f0b9-434e-89f9-4dc3f76a6ed2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:39.399136 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-194129c0-f0b9-434e-89f9-4dc3f76a6ed2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:39.400699 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-194129c0-f0b9-434e-89f9-4dc3f76a6ed2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:39.401796 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-194129c0-f0b9-434e-89f9-4dc3f76a6ed2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:39.405357 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-194129c0-f0b9-434e-89f9-4dc3f76a6ed2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:39.406287 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-194129c0-f0b9-434e-89f9-4dc3f76a6ed2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:39.447894 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-194129c0-f0b9-434e-89f9-4dc3f76a6ed2 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/ips" status: 200 len: 146 microversion: 2.1 time: 0.076973 Aug 26 18:29:39.455978 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 435/854] 10.222.0.45 () {58 vars in 1248 bytes} [Fri Aug 26 18:29:39 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/ips => generated 146 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:29:40.141299 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-99993de5-6e41-4433-b2bc-11a7ebdab94e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:40.142247 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-99993de5-6e41-4433-b2bc-11a7ebdab94e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:40.157103 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-99993de5-6e41-4433-b2bc-11a7ebdab94e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:40.158944 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-99993de5-6e41-4433-b2bc-11a7ebdab94e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:40.161305 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-99993de5-6e41-4433-b2bc-11a7ebdab94e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:40.163088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-99993de5-6e41-4433-b2bc-11a7ebdab94e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:40.174038 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-99993de5-6e41-4433-b2bc-11a7ebdab94e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:40.176064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-99993de5-6e41-4433-b2bc-11a7ebdab94e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:40.377809 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-99993de5-6e41-4433-b2bc-11a7ebdab94e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:40.387744 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-99993de5-6e41-4433-b2bc-11a7ebdab94e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:40.389601 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-99993de5-6e41-4433-b2bc-11a7ebdab94e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:40.391205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-99993de5-6e41-4433-b2bc-11a7ebdab94e tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1739 microversion: 2.20 time: 0.256834 Aug 26 18:29:40.392124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 420/855] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:40 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:40.502121 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1656735247", "imageRef": "4320f78d-800f-443b-b21a-75c749e6ef82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d4880b7-d8b8-43ef-a723-cbc27eb026db"}], "security_groups": [{"name": "tempest-securitygroup--1461098195"}], "key_name": "tempest-keypair-1874891470", "user_data": "}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:40.656318 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] validate_networks() for [('2d4880b7-d8b8-43ef-a723-cbc27eb026db', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:29:41.086313 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c2fd8fc5-8995-43d6-9182-cf5f1730de18 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3a47301-953d-469b-81b9-cc01423d1f2e"}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:41.089401 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c2fd8fc5-8995-43d6-9182-cf5f1730de18 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:41.095559 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2fd8fc5-8995-43d6-9182-cf5f1730de18 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:41.096327 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2fd8fc5-8995-43d6-9182-cf5f1730de18 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:41.096998 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2fd8fc5-8995-43d6-9182-cf5f1730de18 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:41.097860 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2fd8fc5-8995-43d6-9182-cf5f1730de18 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:41.098448 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2fd8fc5-8995-43d6-9182-cf5f1730de18 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:41.099045 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c2fd8fc5-8995-43d6-9182-cf5f1730de18 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:41.215049 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:29:41.215462 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:29:41.216362 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:29:41.216362 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:29:41.216776 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:29:41.226566 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:41.227070 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:41.227499 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:41.228303 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:41.228736 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:41.229218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:41.247074 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:29:41.251667 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Getting quotas for user a1be02f9e7fd4bdabc05ec48e2a35f56 and project 67f4fd75428040ab9ff8a0458e4708fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:29:41.263822 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:29:41.266301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4320f78d-800f-443b-b21a-75c749e6ef82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:29:41.317077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7f1a867d-61ef-4f63-bcad-5fd71b6b7580 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.819530 Aug 26 18:29:41.317760 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 436/856] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:29:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 18:29:41.329194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8a3448c5-432c-4ca3-8a10-c73dba949f8a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:41.329689 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8a3448c5-432c-4ca3-8a10-c73dba949f8a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:41.368515 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c2fd8fc5-8995-43d6-9182-cf5f1730de18 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "POST /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286418 Aug 26 18:29:41.369526 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 421/857] 10.222.0.45 () {60 vars in 1323 bytes} [Fri Aug 26 18:29:41 2022] POST /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:29:41.387661 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8a3448c5-432c-4ca3-8a10-c73dba949f8a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:41.394835 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8a3448c5-432c-4ca3-8a10-c73dba949f8a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1242 microversion: 2.1 time: 0.069725 Aug 26 18:29:41.395489 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 437/858] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:41 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:41.423918 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-05a7858a-3259-439f-bbf6-422afa2da93b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:41.424632 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-05a7858a-3259-439f-bbf6-422afa2da93b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:41.431179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-05a7858a-3259-439f-bbf6-422afa2da93b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:41.431677 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-05a7858a-3259-439f-bbf6-422afa2da93b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:41.432115 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-05a7858a-3259-439f-bbf6-422afa2da93b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:41.432867 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-05a7858a-3259-439f-bbf6-422afa2da93b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:41.433322 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-05a7858a-3259-439f-bbf6-422afa2da93b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:41.433799 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-05a7858a-3259-439f-bbf6-422afa2da93b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:41.603512 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-05a7858a-3259-439f-bbf6-422afa2da93b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:41.611906 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-05a7858a-3259-439f-bbf6-422afa2da93b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:41.613351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-05a7858a-3259-439f-bbf6-422afa2da93b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:41.614537 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-05a7858a-3259-439f-bbf6-422afa2da93b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1739 microversion: 2.20 time: 0.196077 Aug 26 18:29:41.615080 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 422/859] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:41 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:42.418638 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8123dd80-1d3f-4c40-9ec9-2cd86d4552c7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:42.419213 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8123dd80-1d3f-4c40-9ec9-2cd86d4552c7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:42.428223 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8123dd80-1d3f-4c40-9ec9-2cd86d4552c7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:42.428739 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8123dd80-1d3f-4c40-9ec9-2cd86d4552c7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:42.429247 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8123dd80-1d3f-4c40-9ec9-2cd86d4552c7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:42.430090 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8123dd80-1d3f-4c40-9ec9-2cd86d4552c7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:42.430627 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8123dd80-1d3f-4c40-9ec9-2cd86d4552c7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:42.431226 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8123dd80-1d3f-4c40-9ec9-2cd86d4552c7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:42.519471 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8123dd80-1d3f-4c40-9ec9-2cd86d4552c7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:42.528870 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8123dd80-1d3f-4c40-9ec9-2cd86d4552c7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1294 microversion: 2.1 time: 0.116603 Aug 26 18:29:42.529558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 438/860] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:42 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1294 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:42.637524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e3295c0a-1318-4335-9df6-493f77eaa578 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:42.638205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e3295c0a-1318-4335-9df6-493f77eaa578 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:42.644530 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e3295c0a-1318-4335-9df6-493f77eaa578 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:42.645264 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e3295c0a-1318-4335-9df6-493f77eaa578 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:42.645770 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e3295c0a-1318-4335-9df6-493f77eaa578 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:42.646530 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e3295c0a-1318-4335-9df6-493f77eaa578 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:42.647052 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e3295c0a-1318-4335-9df6-493f77eaa578 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:42.647537 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e3295c0a-1318-4335-9df6-493f77eaa578 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:42.784937 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e3295c0a-1318-4335-9df6-493f77eaa578 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:42.795506 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e3295c0a-1318-4335-9df6-493f77eaa578 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:42.796974 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e3295c0a-1318-4335-9df6-493f77eaa578 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:42.798141 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e3295c0a-1318-4335-9df6-493f77eaa578 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1721 microversion: 2.20 time: 0.164554 Aug 26 18:29:42.798702 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 423/861] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:42 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:43.550456 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8eac44a2-f868-470c-a214-cb7838f57ddd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:43.551085 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8eac44a2-f868-470c-a214-cb7838f57ddd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:43.558003 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eac44a2-f868-470c-a214-cb7838f57ddd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:43.558493 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eac44a2-f868-470c-a214-cb7838f57ddd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:43.558930 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eac44a2-f868-470c-a214-cb7838f57ddd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:43.559627 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eac44a2-f868-470c-a214-cb7838f57ddd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:43.560080 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eac44a2-f868-470c-a214-cb7838f57ddd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:43.560502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eac44a2-f868-470c-a214-cb7838f57ddd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:43.622996 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8eac44a2-f868-470c-a214-cb7838f57ddd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:43.630879 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8eac44a2-f868-470c-a214-cb7838f57ddd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1302 microversion: 2.1 time: 0.084384 Aug 26 18:29:43.631444 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 439/862] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:43 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1302 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:43.821467 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c74736cc-6da2-40d1-b983-6deacdfc35c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:43.822101 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c74736cc-6da2-40d1-b983-6deacdfc35c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:43.829463 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c74736cc-6da2-40d1-b983-6deacdfc35c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:43.829948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c74736cc-6da2-40d1-b983-6deacdfc35c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:43.830382 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c74736cc-6da2-40d1-b983-6deacdfc35c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:43.831100 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c74736cc-6da2-40d1-b983-6deacdfc35c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:43.831568 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c74736cc-6da2-40d1-b983-6deacdfc35c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:43.831984 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c74736cc-6da2-40d1-b983-6deacdfc35c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:44.058057 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c74736cc-6da2-40d1-b983-6deacdfc35c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:44.070182 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c74736cc-6da2-40d1-b983-6deacdfc35c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:44.071630 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c74736cc-6da2-40d1-b983-6deacdfc35c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:44.073189 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c74736cc-6da2-40d1-b983-6deacdfc35c4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1721 microversion: 2.20 time: 0.255554 Aug 26 18:29:44.073930 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 424/863] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:43 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:44.652439 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0a463eb0-eab2-4b44-b305-0713a91ab2e8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:44.653568 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0a463eb0-eab2-4b44-b305-0713a91ab2e8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:44.660057 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a463eb0-eab2-4b44-b305-0713a91ab2e8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:44.660535 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a463eb0-eab2-4b44-b305-0713a91ab2e8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:44.660985 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a463eb0-eab2-4b44-b305-0713a91ab2e8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:44.661672 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a463eb0-eab2-4b44-b305-0713a91ab2e8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:44.662118 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a463eb0-eab2-4b44-b305-0713a91ab2e8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:44.662560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a463eb0-eab2-4b44-b305-0713a91ab2e8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:44.665441 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:44.810430 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0a463eb0-eab2-4b44-b305-0713a91ab2e8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:44.825475 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0a463eb0-eab2-4b44-b305-0713a91ab2e8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1368 microversion: 2.1 time: 0.177057 Aug 26 18:29:44.826442 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 440/864] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:44 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:45.096912 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4d1f9c17-a3ed-408e-aa71-89d20236287b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:45.097672 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4d1f9c17-a3ed-408e-aa71-89d20236287b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:45.105027 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4d1f9c17-a3ed-408e-aa71-89d20236287b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:45.105717 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4d1f9c17-a3ed-408e-aa71-89d20236287b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:45.106156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4d1f9c17-a3ed-408e-aa71-89d20236287b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:45.106867 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4d1f9c17-a3ed-408e-aa71-89d20236287b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:45.107310 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4d1f9c17-a3ed-408e-aa71-89d20236287b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:45.107950 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4d1f9c17-a3ed-408e-aa71-89d20236287b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:45.386122 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-4d1f9c17-a3ed-408e-aa71-89d20236287b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:45.395255 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-4d1f9c17-a3ed-408e-aa71-89d20236287b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:45.396695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-4d1f9c17-a3ed-408e-aa71-89d20236287b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:45.398036 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4d1f9c17-a3ed-408e-aa71-89d20236287b tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1664 microversion: 2.20 time: 0.305362 Aug 26 18:29:45.398619 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 425/865] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:45 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1664 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:45.423263 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-50db399a-575d-45c4-9917-1db891b99137 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ef129a8-30e4-4a59-8b47-f55e2be435ed"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:45.426316 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-50db399a-575d-45c4-9917-1db891b99137 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:45.433101 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50db399a-575d-45c4-9917-1db891b99137 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:45.433598 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50db399a-575d-45c4-9917-1db891b99137 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:45.434057 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50db399a-575d-45c4-9917-1db891b99137 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:45.434766 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50db399a-575d-45c4-9917-1db891b99137 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:45.435215 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50db399a-575d-45c4-9917-1db891b99137 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:45.435634 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50db399a-575d-45c4-9917-1db891b99137 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:45.488794 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-ce4c1c49-cd7a-4cdc-a883-ba10b3006bc7 req-0a1e6c2e-2503-4bd8-a188-fd22424be327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028c2a48-f55d-4b36-998a-ce813da73734", "tag": "ab9be478-b4ed-4055-9dae-990851a1722e"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:45.500150 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ce4c1c49-cd7a-4cdc-a883-ba10b3006bc7 req-0a1e6c2e-2503-4bd8-a188-fd22424be327 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:45.500990 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ce4c1c49-cd7a-4cdc-a883-ba10b3006bc7 req-0a1e6c2e-2503-4bd8-a188-fd22424be327 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:45.501428 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ce4c1c49-cd7a-4cdc-a883-ba10b3006bc7 req-0a1e6c2e-2503-4bd8-a188-fd22424be327 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:45.513778 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-ce4c1c49-cd7a-4cdc-a883-ba10b3006bc7 req-0a1e6c2e-2503-4bd8-a188-fd22424be327 service nova] Creating event network-changed:ab9be478-b4ed-4055-9dae-990851a1722e for instance 028c2a48-f55d-4b36-998a-ce813da73734 on hv-cinder-85199 Aug 26 18:29:45.526066 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-ce4c1c49-cd7a-4cdc-a883-ba10b3006bc7 req-0a1e6c2e-2503-4bd8-a188-fd22424be327 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041263 Aug 26 18:29:45.526718 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 426/866] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:29:45.760893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-50db399a-575d-45c4-9917-1db891b99137 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "POST /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341800 Aug 26 18:29:45.766737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 441/867] 10.222.0.45 () {62 vars in 1364 bytes} [Fri Aug 26 18:29:45 2022] POST /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163/os-volume_attachments => generated 188 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 18:29:45.849075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-819dcb38-aca7-4952-8a6f-2e007b9f909e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:45.850699 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-819dcb38-aca7-4952-8a6f-2e007b9f909e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:45.859147 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-819dcb38-aca7-4952-8a6f-2e007b9f909e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:45.860008 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-819dcb38-aca7-4952-8a6f-2e007b9f909e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:45.860447 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-819dcb38-aca7-4952-8a6f-2e007b9f909e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:45.861486 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-819dcb38-aca7-4952-8a6f-2e007b9f909e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:45.861929 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-819dcb38-aca7-4952-8a6f-2e007b9f909e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:45.862343 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-819dcb38-aca7-4952-8a6f-2e007b9f909e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:45.894249 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6cc49aa4-8fef-4bf9-8ae0-a59f26886fd5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:45.894646 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6cc49aa4-8fef-4bf9-8ae0-a59f26886fd5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:45.901008 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cc49aa4-8fef-4bf9-8ae0-a59f26886fd5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:45.901511 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cc49aa4-8fef-4bf9-8ae0-a59f26886fd5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:45.901946 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cc49aa4-8fef-4bf9-8ae0-a59f26886fd5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:45.902691 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cc49aa4-8fef-4bf9-8ae0-a59f26886fd5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:45.903886 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cc49aa4-8fef-4bf9-8ae0-a59f26886fd5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:45.903886 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cc49aa4-8fef-4bf9-8ae0-a59f26886fd5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:46.054575 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-819dcb38-aca7-4952-8a6f-2e007b9f909e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:46.062789 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-819dcb38-aca7-4952-8a6f-2e007b9f909e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1368 microversion: 2.1 time: 0.219007 Aug 26 18:29:46.063355 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 427/868] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:45 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:46.151745 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6cc49aa4-8fef-4bf9-8ae0-a59f26886fd5 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163/os-volume_attachments/6ef129a8-30e4-4a59-8b47-f55e2be435ed" status: 202 len: 0 microversion: 2.20 time: 0.261473 Aug 26 18:29:46.152415 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 442/869] 10.222.0.45 () {60 vars in 1457 bytes} [Fri Aug 26 18:29:45 2022] DELETE /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163/os-volume_attachments/6ef129a8-30e4-4a59-8b47-f55e2be435ed => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:29:46.215566 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-cb1ae5a5-127d-48f5-b81d-201022f3bbaf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:46.216308 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-cb1ae5a5-127d-48f5-b81d-201022f3bbaf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:46.223083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cb1ae5a5-127d-48f5-b81d-201022f3bbaf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:46.223755 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cb1ae5a5-127d-48f5-b81d-201022f3bbaf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:46.224190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cb1ae5a5-127d-48f5-b81d-201022f3bbaf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:46.224924 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cb1ae5a5-127d-48f5-b81d-201022f3bbaf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:46.225429 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cb1ae5a5-127d-48f5-b81d-201022f3bbaf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:46.225858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cb1ae5a5-127d-48f5-b81d-201022f3bbaf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:46.270662 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-cb1ae5a5-127d-48f5-b81d-201022f3bbaf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120540) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 18:29:46.343284 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-cb1ae5a5-127d-48f5-b81d-201022f3bbaf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "POST /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163/action" status: 202 len: 0 microversion: 2.20 time: 0.132593 Aug 26 18:29:46.345293 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 428/870] 10.222.0.45 () {62 vars in 1319 bytes} [Fri Aug 26 18:29:46 2022] POST /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:29:46.355823 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a952c53d-3287-4829-a9f6-74a596eb1b5f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:46.356426 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a952c53d-3287-4829-a9f6-74a596eb1b5f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:46.363614 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a952c53d-3287-4829-a9f6-74a596eb1b5f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:46.364145 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a952c53d-3287-4829-a9f6-74a596eb1b5f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:46.364791 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a952c53d-3287-4829-a9f6-74a596eb1b5f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:46.365592 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a952c53d-3287-4829-a9f6-74a596eb1b5f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:46.366127 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a952c53d-3287-4829-a9f6-74a596eb1b5f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:46.366702 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a952c53d-3287-4829-a9f6-74a596eb1b5f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:46.508972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a952c53d-3287-4829-a9f6-74a596eb1b5f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:46.517855 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a952c53d-3287-4829-a9f6-74a596eb1b5f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:46.519249 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a952c53d-3287-4829-a9f6-74a596eb1b5f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:46.520642 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a952c53d-3287-4829-a9f6-74a596eb1b5f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1672 microversion: 2.20 time: 0.170347 Aug 26 18:29:46.521449 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 443/871] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:46 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:46.770124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-1aeca483-4c9b-4709-8951-d8256a572091 req-8425a204-bf81-4f0c-9e3b-04d0ae89baa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82d25b8-bf09-48ca-9098-20bff440e163", "name": "network-vif-unplugged", "status": "completed", "tag": "9120b3ad-b9e1-459d-b90c-56a0a48c2f3d"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:46.786319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-1aeca483-4c9b-4709-8951-d8256a572091 req-8425a204-bf81-4f0c-9e3b-04d0ae89baa9 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:46.792921 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-1aeca483-4c9b-4709-8951-d8256a572091 req-8425a204-bf81-4f0c-9e3b-04d0ae89baa9 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:46.793941 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-1aeca483-4c9b-4709-8951-d8256a572091 req-8425a204-bf81-4f0c-9e3b-04d0ae89baa9 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:46.809514 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.compute.server_external_events [req-1aeca483-4c9b-4709-8951-d8256a572091 req-8425a204-bf81-4f0c-9e3b-04d0ae89baa9 service nova] Unable to find a host for instance f82d25b8-bf09-48ca-9098-20bff440e163. Dropping event network-vif-unplugged {{(pid=120540) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 26 18:29:46.811136 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-1aeca483-4c9b-4709-8951-d8256a572091 req-8425a204-bf81-4f0c-9e3b-04d0ae89baa9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045238 Aug 26 18:29:46.811917 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 429/872] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 26 18:29:47.084656 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4a69c523-aa72-4ed2-a353-9eb5ee61361e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:47.085819 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4a69c523-aa72-4ed2-a353-9eb5ee61361e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:47.093550 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a69c523-aa72-4ed2-a353-9eb5ee61361e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:47.094136 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a69c523-aa72-4ed2-a353-9eb5ee61361e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:47.094820 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a69c523-aa72-4ed2-a353-9eb5ee61361e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:47.095770 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a69c523-aa72-4ed2-a353-9eb5ee61361e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:47.096220 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a69c523-aa72-4ed2-a353-9eb5ee61361e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:47.096647 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a69c523-aa72-4ed2-a353-9eb5ee61361e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:47.472018 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4a69c523-aa72-4ed2-a353-9eb5ee61361e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:47.485766 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4a69c523-aa72-4ed2-a353-9eb5ee61361e tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1368 microversion: 2.1 time: 0.405332 Aug 26 18:29:47.486546 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 444/873] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:47 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1368 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:47.543529 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f23d379a-1b1b-46b0-8043-eef86b992e14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:47.544146 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f23d379a-1b1b-46b0-8043-eef86b992e14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:47.551361 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f23d379a-1b1b-46b0-8043-eef86b992e14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:47.551941 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f23d379a-1b1b-46b0-8043-eef86b992e14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:47.552441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f23d379a-1b1b-46b0-8043-eef86b992e14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:47.553271 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f23d379a-1b1b-46b0-8043-eef86b992e14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:47.553839 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f23d379a-1b1b-46b0-8043-eef86b992e14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:47.554334 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f23d379a-1b1b-46b0-8043-eef86b992e14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:47.695311 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f23d379a-1b1b-46b0-8043-eef86b992e14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:47.704217 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f23d379a-1b1b-46b0-8043-eef86b992e14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:47.706303 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f23d379a-1b1b-46b0-8043-eef86b992e14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:47.707888 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f23d379a-1b1b-46b0-8043-eef86b992e14 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1674 microversion: 2.20 time: 0.168260 Aug 26 18:29:47.708482 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 430/874] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:47 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:29:48.509434 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bd795040-f4ea-404f-b9b9-bdb8c0fa9a98 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:48.509996 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bd795040-f4ea-404f-b9b9-bdb8c0fa9a98 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:48.516829 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd795040-f4ea-404f-b9b9-bdb8c0fa9a98 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:48.517309 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd795040-f4ea-404f-b9b9-bdb8c0fa9a98 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:48.517731 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd795040-f4ea-404f-b9b9-bdb8c0fa9a98 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:48.518416 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd795040-f4ea-404f-b9b9-bdb8c0fa9a98 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:48.518876 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd795040-f4ea-404f-b9b9-bdb8c0fa9a98 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:48.519295 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd795040-f4ea-404f-b9b9-bdb8c0fa9a98 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:48.651505 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bd795040-f4ea-404f-b9b9-bdb8c0fa9a98 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:48.663709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bd795040-f4ea-404f-b9b9-bdb8c0fa9a98 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1368 microversion: 2.1 time: 0.159125 Aug 26 18:29:48.664201 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 445/875] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:48 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:48.735261 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-79e53d3b-3771-4bc3-a842-d998eb4e2c58 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:48.736236 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-79e53d3b-3771-4bc3-a842-d998eb4e2c58 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:48.747286 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79e53d3b-3771-4bc3-a842-d998eb4e2c58 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:48.748085 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79e53d3b-3771-4bc3-a842-d998eb4e2c58 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:48.748794 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79e53d3b-3771-4bc3-a842-d998eb4e2c58 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:48.749973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79e53d3b-3771-4bc3-a842-d998eb4e2c58 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:48.750761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79e53d3b-3771-4bc3-a842-d998eb4e2c58 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:48.751465 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-79e53d3b-3771-4bc3-a842-d998eb4e2c58 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:48.882548 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-79e53d3b-3771-4bc3-a842-d998eb4e2c58 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:48.891097 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-79e53d3b-3771-4bc3-a842-d998eb4e2c58 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:48.892529 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-79e53d3b-3771-4bc3-a842-d998eb4e2c58 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:48.893687 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-79e53d3b-3771-4bc3-a842-d998eb4e2c58 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.164966 Aug 26 18:29:48.894247 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 431/876] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:48 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:48.987219 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c6f1ae82-8eb5-4367-91f0-bcd978ff1ffd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:48.990669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c6f1ae82-8eb5-4367-91f0-bcd978ff1ffd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:48.998985 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6f1ae82-8eb5-4367-91f0-bcd978ff1ffd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:48.999659 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6f1ae82-8eb5-4367-91f0-bcd978ff1ffd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:49.000174 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6f1ae82-8eb5-4367-91f0-bcd978ff1ffd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:49.000988 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6f1ae82-8eb5-4367-91f0-bcd978ff1ffd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:49.001420 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6f1ae82-8eb5-4367-91f0-bcd978ff1ffd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:49.001916 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6f1ae82-8eb5-4367-91f0-bcd978ff1ffd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:49.036066 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c6f1ae82-8eb5-4367-91f0-bcd978ff1ffd tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055648 Aug 26 18:29:49.036868 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 446/877] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:29:48 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:29:49.047841 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1cf7e96d-7270-4106-be05-1fa107c2be95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:49.048340 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1cf7e96d-7270-4106-be05-1fa107c2be95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:49.054582 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1cf7e96d-7270-4106-be05-1fa107c2be95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:49.055062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1cf7e96d-7270-4106-be05-1fa107c2be95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:49.055495 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1cf7e96d-7270-4106-be05-1fa107c2be95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:49.056183 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1cf7e96d-7270-4106-be05-1fa107c2be95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:49.056624 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1cf7e96d-7270-4106-be05-1fa107c2be95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:49.057064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1cf7e96d-7270-4106-be05-1fa107c2be95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:49.086143 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1cf7e96d-7270-4106-be05-1fa107c2be95 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments/a3a47301-953d-469b-81b9-cc01423d1f2e" status: 200 len: 194 microversion: 2.1 time: 0.042243 Aug 26 18:29:49.086755 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 432/878] 10.222.0.45 () {58 vars in 1413 bytes} [Fri Aug 26 18:29:49 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments/a3a47301-953d-469b-81b9-cc01423d1f2e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:29:49.689033 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ec630231-b0c8-4a52-8fb5-7b26b98d560a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:49.689998 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ec630231-b0c8-4a52-8fb5-7b26b98d560a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:49.700708 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec630231-b0c8-4a52-8fb5-7b26b98d560a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:49.701545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec630231-b0c8-4a52-8fb5-7b26b98d560a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:49.702262 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec630231-b0c8-4a52-8fb5-7b26b98d560a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:49.703418 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec630231-b0c8-4a52-8fb5-7b26b98d560a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:49.704168 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec630231-b0c8-4a52-8fb5-7b26b98d560a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:49.704940 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec630231-b0c8-4a52-8fb5-7b26b98d560a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:49.842993 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ec630231-b0c8-4a52-8fb5-7b26b98d560a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:49.850952 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ec630231-b0c8-4a52-8fb5-7b26b98d560a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1368 microversion: 2.1 time: 0.168304 Aug 26 18:29:49.851503 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 447/879] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:49 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:49.916090 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-36347ae4-d548-4fe8-9c8e-c92d833e7caf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:49.916660 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-36347ae4-d548-4fe8-9c8e-c92d833e7caf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:49.923383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-36347ae4-d548-4fe8-9c8e-c92d833e7caf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:49.923851 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-36347ae4-d548-4fe8-9c8e-c92d833e7caf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:49.924273 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-36347ae4-d548-4fe8-9c8e-c92d833e7caf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:49.925003 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-36347ae4-d548-4fe8-9c8e-c92d833e7caf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:49.925440 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-36347ae4-d548-4fe8-9c8e-c92d833e7caf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:49.925850 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-36347ae4-d548-4fe8-9c8e-c92d833e7caf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:50.056221 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-36347ae4-d548-4fe8-9c8e-c92d833e7caf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:50.064453 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-36347ae4-d548-4fe8-9c8e-c92d833e7caf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:50.065914 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-36347ae4-d548-4fe8-9c8e-c92d833e7caf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:50.067065 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-36347ae4-d548-4fe8-9c8e-c92d833e7caf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.154985 Aug 26 18:29:50.067624 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 433/880] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:49 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:29:50.873686 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ea6b0722-7992-4296-b848-81e210e49ec8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:50.874268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ea6b0722-7992-4296-b848-81e210e49ec8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:50.881345 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea6b0722-7992-4296-b848-81e210e49ec8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:50.881769 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea6b0722-7992-4296-b848-81e210e49ec8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:50.882183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea6b0722-7992-4296-b848-81e210e49ec8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:50.882939 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea6b0722-7992-4296-b848-81e210e49ec8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:50.883397 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea6b0722-7992-4296-b848-81e210e49ec8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:50.883815 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea6b0722-7992-4296-b848-81e210e49ec8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:51.029951 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ea6b0722-7992-4296-b848-81e210e49ec8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:51.038446 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ea6b0722-7992-4296-b848-81e210e49ec8 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1368 microversion: 2.1 time: 0.168510 Aug 26 18:29:51.039001 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 448/881] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:50 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:51.090349 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1bcb913f-a109-4e92-91fb-d922275aa29f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:51.091622 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1bcb913f-a109-4e92-91fb-d922275aa29f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:51.098329 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1bcb913f-a109-4e92-91fb-d922275aa29f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:51.098818 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1bcb913f-a109-4e92-91fb-d922275aa29f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:51.099252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1bcb913f-a109-4e92-91fb-d922275aa29f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:51.100148 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1bcb913f-a109-4e92-91fb-d922275aa29f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:51.100747 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1bcb913f-a109-4e92-91fb-d922275aa29f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:51.101190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1bcb913f-a109-4e92-91fb-d922275aa29f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:51.314910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1bcb913f-a109-4e92-91fb-d922275aa29f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:51.318597 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:51.324788 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1bcb913f-a109-4e92-91fb-d922275aa29f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:51.326215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1bcb913f-a109-4e92-91fb-d922275aa29f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:51.327387 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1bcb913f-a109-4e92-91fb-d922275aa29f tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.241187 Aug 26 18:29:51.327981 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 434/882] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:51 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:51.489369 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-729cc5c1-91af-4e96-8e48-7d4e77768ed9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fe03495-a77a-46a8-822b-6babe4cfb170"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:51.491737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-729cc5c1-91af-4e96-8e48-7d4e77768ed9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:51.493757 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:51.494479 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=12 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:51.500508 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-729cc5c1-91af-4e96-8e48-7d4e77768ed9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:51.501019 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-729cc5c1-91af-4e96-8e48-7d4e77768ed9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:51.501446 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-729cc5c1-91af-4e96-8e48-7d4e77768ed9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:51.502135 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-729cc5c1-91af-4e96-8e48-7d4e77768ed9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:51.502579 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-729cc5c1-91af-4e96-8e48-7d4e77768ed9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:51.502994 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-729cc5c1-91af-4e96-8e48-7d4e77768ed9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:51.779597 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-729cc5c1-91af-4e96-8e48-7d4e77768ed9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "POST /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294097 Aug 26 18:29:51.780293 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 449/883] 10.222.0.45 () {60 vars in 1323 bytes} [Fri Aug 26 18:29:51 2022] POST /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:29:52.059693 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-bef1fdca-28d5-4ec0-9676-0bf2282bc5c3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:52.060217 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-bef1fdca-28d5-4ec0-9676-0bf2282bc5c3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:52.071806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bef1fdca-28d5-4ec0-9676-0bf2282bc5c3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:52.072305 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bef1fdca-28d5-4ec0-9676-0bf2282bc5c3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:52.072750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bef1fdca-28d5-4ec0-9676-0bf2282bc5c3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:52.073459 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bef1fdca-28d5-4ec0-9676-0bf2282bc5c3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:52.073903 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bef1fdca-28d5-4ec0-9676-0bf2282bc5c3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:52.074320 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-bef1fdca-28d5-4ec0-9676-0bf2282bc5c3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:52.262190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-bef1fdca-28d5-4ec0-9676-0bf2282bc5c3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:52.281867 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-bef1fdca-28d5-4ec0-9676-0bf2282bc5c3 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1368 microversion: 2.1 time: 0.225711 Aug 26 18:29:52.283273 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 435/884] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:52 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:52.352820 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-890c6f05-ca26-433e-b9db-0a769cd2a1e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:52.353535 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-890c6f05-ca26-433e-b9db-0a769cd2a1e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:52.355730 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:52.389718 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-890c6f05-ca26-433e-b9db-0a769cd2a1e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:52.391351 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-890c6f05-ca26-433e-b9db-0a769cd2a1e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:52.392176 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-890c6f05-ca26-433e-b9db-0a769cd2a1e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:52.395609 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-890c6f05-ca26-433e-b9db-0a769cd2a1e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:52.396278 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-890c6f05-ca26-433e-b9db-0a769cd2a1e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:52.396846 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-890c6f05-ca26-433e-b9db-0a769cd2a1e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:52.424026 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=6,nova_cell1:UPDATE=10 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:29:52.592011 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-890c6f05-ca26-433e-b9db-0a769cd2a1e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:52.601144 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-890c6f05-ca26-433e-b9db-0a769cd2a1e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:52.602647 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-890c6f05-ca26-433e-b9db-0a769cd2a1e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:52.604230 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-890c6f05-ca26-433e-b9db-0a769cd2a1e2 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.257201 Aug 26 18:29:52.608988 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 450/885] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:52 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:52.986294 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-df112066-b07c-4493-913d-4a206f96954a req-c2f4318c-9533-4a71-9435-b3c82f7ef9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028c2a48-f55d-4b36-998a-ce813da73734", "name": "network-vif-plugged", "status": "completed", "tag": "ab9be478-b4ed-4055-9dae-990851a1722e"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:29:53.002795 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-df112066-b07c-4493-913d-4a206f96954a req-c2f4318c-9533-4a71-9435-b3c82f7ef9e3 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:53.003873 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-df112066-b07c-4493-913d-4a206f96954a req-c2f4318c-9533-4a71-9435-b3c82f7ef9e3 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:53.004831 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-df112066-b07c-4493-913d-4a206f96954a req-c2f4318c-9533-4a71-9435-b3c82f7ef9e3 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:53.022621 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-df112066-b07c-4493-913d-4a206f96954a req-c2f4318c-9533-4a71-9435-b3c82f7ef9e3 service nova] Creating event network-vif-plugged:ab9be478-b4ed-4055-9dae-990851a1722e for instance 028c2a48-f55d-4b36-998a-ce813da73734 on hv-cinder-85199 Aug 26 18:29:53.029241 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-df112066-b07c-4493-913d-4a206f96954a req-c2f4318c-9533-4a71-9435-b3c82f7ef9e3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048053 Aug 26 18:29:53.029948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 436/886] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:29:53.303927 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3fc77798-54d6-4314-a293-be89d08c9741 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:53.304534 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3fc77798-54d6-4314-a293-be89d08c9741 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:53.311493 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fc77798-54d6-4314-a293-be89d08c9741 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:53.311985 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fc77798-54d6-4314-a293-be89d08c9741 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:53.312419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fc77798-54d6-4314-a293-be89d08c9741 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:53.313154 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fc77798-54d6-4314-a293-be89d08c9741 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:53.313605 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fc77798-54d6-4314-a293-be89d08c9741 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:53.314020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fc77798-54d6-4314-a293-be89d08c9741 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:53.458933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3fc77798-54d6-4314-a293-be89d08c9741 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:53.472628 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3fc77798-54d6-4314-a293-be89d08c9741 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1368 microversion: 2.1 time: 0.172963 Aug 26 18:29:53.480618 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 451/887] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:53 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:53.632961 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8945af31-536f-4908-816b-b7bc68496b96 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:53.633632 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8945af31-536f-4908-816b-b7bc68496b96 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:53.648109 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8945af31-536f-4908-816b-b7bc68496b96 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:53.648601 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8945af31-536f-4908-816b-b7bc68496b96 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:53.649065 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8945af31-536f-4908-816b-b7bc68496b96 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:53.649935 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8945af31-536f-4908-816b-b7bc68496b96 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:53.650487 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8945af31-536f-4908-816b-b7bc68496b96 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:53.650935 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8945af31-536f-4908-816b-b7bc68496b96 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:53.798796 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8945af31-536f-4908-816b-b7bc68496b96 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:53.810184 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8945af31-536f-4908-816b-b7bc68496b96 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:53.813192 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8945af31-536f-4908-816b-b7bc68496b96 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:53.814403 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8945af31-536f-4908-816b-b7bc68496b96 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.186428 Aug 26 18:29:53.815316 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 437/888] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:53 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:54.494665 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-41ad84eb-c570-4a63-ae48-e342dad293b4 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:54.495258 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-41ad84eb-c570-4a63-ae48-e342dad293b4 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:54.504906 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41ad84eb-c570-4a63-ae48-e342dad293b4 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:54.504906 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41ad84eb-c570-4a63-ae48-e342dad293b4 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:54.504906 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41ad84eb-c570-4a63-ae48-e342dad293b4 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:54.504906 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41ad84eb-c570-4a63-ae48-e342dad293b4 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:54.505411 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41ad84eb-c570-4a63-ae48-e342dad293b4 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:54.505411 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41ad84eb-c570-4a63-ae48-e342dad293b4 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:54.652356 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-41ad84eb-c570-4a63-ae48-e342dad293b4 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:54.661181 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-41ad84eb-c570-4a63-ae48-e342dad293b4 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1368 microversion: 2.1 time: 0.170476 Aug 26 18:29:54.672770 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 452/889] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:54 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:54.838360 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-892b6bf1-60ce-4222-acf4-9f570ab0e92d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:54.838955 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-892b6bf1-60ce-4222-acf4-9f570ab0e92d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:54.845702 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-892b6bf1-60ce-4222-acf4-9f570ab0e92d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:54.846211 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-892b6bf1-60ce-4222-acf4-9f570ab0e92d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:54.846683 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-892b6bf1-60ce-4222-acf4-9f570ab0e92d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:54.847378 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-892b6bf1-60ce-4222-acf4-9f570ab0e92d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:54.847838 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-892b6bf1-60ce-4222-acf4-9f570ab0e92d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:54.848255 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-892b6bf1-60ce-4222-acf4-9f570ab0e92d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:54.996641 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-892b6bf1-60ce-4222-acf4-9f570ab0e92d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:55.005693 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-892b6bf1-60ce-4222-acf4-9f570ab0e92d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:55.007547 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-892b6bf1-60ce-4222-acf4-9f570ab0e92d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:55.008908 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-892b6bf1-60ce-4222-acf4-9f570ab0e92d tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.174452 Aug 26 18:29:55.009794 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 438/890] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:54 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:29:55.683920 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ac892912-14ff-4877-937f-c064ca8ec9bd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:55.685360 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ac892912-14ff-4877-937f-c064ca8ec9bd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:55.692956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac892912-14ff-4877-937f-c064ca8ec9bd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:55.693495 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac892912-14ff-4877-937f-c064ca8ec9bd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:55.693992 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac892912-14ff-4877-937f-c064ca8ec9bd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:55.695054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac892912-14ff-4877-937f-c064ca8ec9bd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:55.695570 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac892912-14ff-4877-937f-c064ca8ec9bd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:55.696061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac892912-14ff-4877-937f-c064ca8ec9bd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:55.834869 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ac892912-14ff-4877-937f-c064ca8ec9bd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:55.844487 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ac892912-14ff-4877-937f-c064ca8ec9bd tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1368 microversion: 2.1 time: 0.165893 Aug 26 18:29:55.845762 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 453/891] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:55 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:56.035663 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7ad1b2c6-5e5e-4178-bac1-397305a28ac9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:56.035663 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-7ad1b2c6-5e5e-4178-bac1-397305a28ac9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:56.041188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7ad1b2c6-5e5e-4178-bac1-397305a28ac9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:56.041779 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7ad1b2c6-5e5e-4178-bac1-397305a28ac9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:56.042293 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7ad1b2c6-5e5e-4178-bac1-397305a28ac9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:56.043076 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7ad1b2c6-5e5e-4178-bac1-397305a28ac9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:56.043741 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7ad1b2c6-5e5e-4178-bac1-397305a28ac9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:56.044167 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7ad1b2c6-5e5e-4178-bac1-397305a28ac9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:56.216993 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-7ad1b2c6-5e5e-4178-bac1-397305a28ac9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:56.240884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-7ad1b2c6-5e5e-4178-bac1-397305a28ac9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:56.240884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-7ad1b2c6-5e5e-4178-bac1-397305a28ac9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:56.241442 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-7ad1b2c6-5e5e-4178-bac1-397305a28ac9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.212208 Aug 26 18:29:56.260562 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 439/892] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:56 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:56.867184 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f7a09e8c-eb5c-4956-86c9-66626b1d6c40 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:56.867941 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f7a09e8c-eb5c-4956-86c9-66626b1d6c40 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:56.874845 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7a09e8c-eb5c-4956-86c9-66626b1d6c40 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:56.875653 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7a09e8c-eb5c-4956-86c9-66626b1d6c40 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:56.876082 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7a09e8c-eb5c-4956-86c9-66626b1d6c40 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:56.876797 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7a09e8c-eb5c-4956-86c9-66626b1d6c40 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:56.877395 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7a09e8c-eb5c-4956-86c9-66626b1d6c40 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:56.878078 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7a09e8c-eb5c-4956-86c9-66626b1d6c40 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:57.031945 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f7a09e8c-eb5c-4956-86c9-66626b1d6c40 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:57.036366 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f7a09e8c-eb5c-4956-86c9-66626b1d6c40 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1368 microversion: 2.1 time: 0.173732 Aug 26 18:29:57.040194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 454/893] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:56 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:57.265110 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-a1526a40-d877-4a50-9791-281605b426dd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:57.265722 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-a1526a40-d877-4a50-9791-281605b426dd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:57.272624 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a1526a40-d877-4a50-9791-281605b426dd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:57.273234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a1526a40-d877-4a50-9791-281605b426dd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:57.273694 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a1526a40-d877-4a50-9791-281605b426dd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:57.274424 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a1526a40-d877-4a50-9791-281605b426dd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:57.274874 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a1526a40-d877-4a50-9791-281605b426dd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:57.275327 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a1526a40-d877-4a50-9791-281605b426dd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:57.431088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a1526a40-d877-4a50-9791-281605b426dd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:57.440094 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a1526a40-d877-4a50-9791-281605b426dd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:57.441955 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a1526a40-d877-4a50-9791-281605b426dd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:57.443251 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-a1526a40-d877-4a50-9791-281605b426dd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.182086 Aug 26 18:29:57.450442 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 440/894] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:57 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:29:58.058896 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f4297a71-b38e-4ffb-9988-fd7e6232d2f6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:58.059627 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f4297a71-b38e-4ffb-9988-fd7e6232d2f6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:58.066237 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4297a71-b38e-4ffb-9988-fd7e6232d2f6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:58.066721 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4297a71-b38e-4ffb-9988-fd7e6232d2f6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:58.067152 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4297a71-b38e-4ffb-9988-fd7e6232d2f6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:58.067856 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4297a71-b38e-4ffb-9988-fd7e6232d2f6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:58.068304 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4297a71-b38e-4ffb-9988-fd7e6232d2f6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:58.068751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4297a71-b38e-4ffb-9988-fd7e6232d2f6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:58.215853 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f4297a71-b38e-4ffb-9988-fd7e6232d2f6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:58.223947 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f4297a71-b38e-4ffb-9988-fd7e6232d2f6 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1368 microversion: 2.1 time: 0.169088 Aug 26 18:29:58.241127 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 455/895] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:58 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:58.473612 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-b587fba8-e970-42cf-ae49-913821b5cebd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:58.474305 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-b587fba8-e970-42cf-ae49-913821b5cebd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:58.481929 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b587fba8-e970-42cf-ae49-913821b5cebd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:58.482937 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b587fba8-e970-42cf-ae49-913821b5cebd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:58.483623 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b587fba8-e970-42cf-ae49-913821b5cebd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:58.489487 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b587fba8-e970-42cf-ae49-913821b5cebd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:58.490419 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b587fba8-e970-42cf-ae49-913821b5cebd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:58.491128 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-b587fba8-e970-42cf-ae49-913821b5cebd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:58.648318 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b587fba8-e970-42cf-ae49-913821b5cebd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:58.658882 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b587fba8-e970-42cf-ae49-913821b5cebd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:58.661336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-b587fba8-e970-42cf-ae49-913821b5cebd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:58.662898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-b587fba8-e970-42cf-ae49-913821b5cebd tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.193194 Aug 26 18:29:58.663548 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 441/896] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:58 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:29:59.244450 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4c1d9765-6575-410d-b7fc-db982f1df552 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:59.246103 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4c1d9765-6575-410d-b7fc-db982f1df552 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:59.253862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c1d9765-6575-410d-b7fc-db982f1df552 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:59.254634 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c1d9765-6575-410d-b7fc-db982f1df552 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:59.255117 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c1d9765-6575-410d-b7fc-db982f1df552 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:59.256251 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c1d9765-6575-410d-b7fc-db982f1df552 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:59.256809 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c1d9765-6575-410d-b7fc-db982f1df552 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:59.257680 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c1d9765-6575-410d-b7fc-db982f1df552 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:59.412052 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4c1d9765-6575-410d-b7fc-db982f1df552 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:59.420299 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4c1d9765-6575-410d-b7fc-db982f1df552 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1368 microversion: 2.1 time: 0.180231 Aug 26 18:29:59.421106 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 456/897] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:29:59 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:29:59.686480 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c238e3dd-09ef-42fe-963e-07acee54babe tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:29:59.687110 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c238e3dd-09ef-42fe-963e-07acee54babe tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:29:59.693772 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c238e3dd-09ef-42fe-963e-07acee54babe tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:59.694257 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c238e3dd-09ef-42fe-963e-07acee54babe tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:59.695068 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c238e3dd-09ef-42fe-963e-07acee54babe tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:59.695761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c238e3dd-09ef-42fe-963e-07acee54babe tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:29:59.696217 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c238e3dd-09ef-42fe-963e-07acee54babe tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:29:59.696643 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c238e3dd-09ef-42fe-963e-07acee54babe tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:29:59.835675 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c238e3dd-09ef-42fe-963e-07acee54babe tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:59.844383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c238e3dd-09ef-42fe-963e-07acee54babe tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:59.845901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c238e3dd-09ef-42fe-963e-07acee54babe tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:29:59.847062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c238e3dd-09ef-42fe-963e-07acee54babe tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.164546 Aug 26 18:29:59.847603 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 442/898] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:29:59 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:30:00.503590 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f5708aaa-1bf3-4fdc-a26f-aa49f2fe7529 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:00.504285 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f5708aaa-1bf3-4fdc-a26f-aa49f2fe7529 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:00.512156 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5708aaa-1bf3-4fdc-a26f-aa49f2fe7529 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:00.512156 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5708aaa-1bf3-4fdc-a26f-aa49f2fe7529 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:00.512486 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5708aaa-1bf3-4fdc-a26f-aa49f2fe7529 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:00.513174 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5708aaa-1bf3-4fdc-a26f-aa49f2fe7529 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:00.513621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5708aaa-1bf3-4fdc-a26f-aa49f2fe7529 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:00.514062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5708aaa-1bf3-4fdc-a26f-aa49f2fe7529 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:00.647827 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f5708aaa-1bf3-4fdc-a26f-aa49f2fe7529 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:00.656080 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f5708aaa-1bf3-4fdc-a26f-aa49f2fe7529 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1368 microversion: 2.1 time: 0.218660 Aug 26 18:30:00.656646 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 457/899] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:30:00 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:00.872850 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-03069170-0be9-42e7-94d2-4c3637ade0c0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:00.873489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-03069170-0be9-42e7-94d2-4c3637ade0c0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:00.880528 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-03069170-0be9-42e7-94d2-4c3637ade0c0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:00.881036 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-03069170-0be9-42e7-94d2-4c3637ade0c0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:00.881463 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-03069170-0be9-42e7-94d2-4c3637ade0c0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:00.882165 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-03069170-0be9-42e7-94d2-4c3637ade0c0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:00.882603 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-03069170-0be9-42e7-94d2-4c3637ade0c0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:00.883015 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-03069170-0be9-42e7-94d2-4c3637ade0c0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:01.022678 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-03069170-0be9-42e7-94d2-4c3637ade0c0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:01.031605 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-03069170-0be9-42e7-94d2-4c3637ade0c0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:01.033100 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-03069170-0be9-42e7-94d2-4c3637ade0c0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:01.034291 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-03069170-0be9-42e7-94d2-4c3637ade0c0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.165961 Aug 26 18:30:01.034863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 443/900] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:30:00 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:30:01.677600 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-80573914-db62-4bfa-8ddd-eda6ca820f8a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:01.678255 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-80573914-db62-4bfa-8ddd-eda6ca820f8a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:01.685956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80573914-db62-4bfa-8ddd-eda6ca820f8a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:01.686461 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80573914-db62-4bfa-8ddd-eda6ca820f8a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:01.686928 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80573914-db62-4bfa-8ddd-eda6ca820f8a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:01.687651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80573914-db62-4bfa-8ddd-eda6ca820f8a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:01.688106 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80573914-db62-4bfa-8ddd-eda6ca820f8a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:01.688534 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80573914-db62-4bfa-8ddd-eda6ca820f8a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:01.836018 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-80573914-db62-4bfa-8ddd-eda6ca820f8a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:01.843892 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-80573914-db62-4bfa-8ddd-eda6ca820f8a tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1368 microversion: 2.1 time: 0.170393 Aug 26 18:30:01.844462 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 458/901] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:30:01 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:02.057107 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0d14638f-3931-4277-a813-cd5c1b45b29a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:02.057818 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-0d14638f-3931-4277-a813-cd5c1b45b29a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:02.064410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0d14638f-3931-4277-a813-cd5c1b45b29a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:02.065007 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0d14638f-3931-4277-a813-cd5c1b45b29a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:02.065464 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0d14638f-3931-4277-a813-cd5c1b45b29a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:02.066162 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0d14638f-3931-4277-a813-cd5c1b45b29a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:02.066600 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0d14638f-3931-4277-a813-cd5c1b45b29a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:02.066995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0d14638f-3931-4277-a813-cd5c1b45b29a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:02.201377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0d14638f-3931-4277-a813-cd5c1b45b29a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:02.210548 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0d14638f-3931-4277-a813-cd5c1b45b29a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:02.212014 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0d14638f-3931-4277-a813-cd5c1b45b29a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:02.213205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-0d14638f-3931-4277-a813-cd5c1b45b29a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.160059 Aug 26 18:30:02.213775 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 444/902] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:30:02 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:30:02.866187 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-876ce37f-99de-49b2-b976-4f7e005209d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:02.868054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-876ce37f-99de-49b2-b976-4f7e005209d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:02.876339 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-876ce37f-99de-49b2-b976-4f7e005209d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:02.876960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-876ce37f-99de-49b2-b976-4f7e005209d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:02.877402 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-876ce37f-99de-49b2-b976-4f7e005209d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:02.878117 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-876ce37f-99de-49b2-b976-4f7e005209d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:02.878566 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-876ce37f-99de-49b2-b976-4f7e005209d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:02.878988 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-876ce37f-99de-49b2-b976-4f7e005209d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:03.016346 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-876ce37f-99de-49b2-b976-4f7e005209d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:03.024162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-876ce37f-99de-49b2-b976-4f7e005209d7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1558 microversion: 2.1 time: 0.162995 Aug 26 18:30:03.024781 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 459/903] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:30:02 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:03.045390 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-229e99c2-3fa0-49dd-92c1-ca11375d7117 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:03.046005 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-229e99c2-3fa0-49dd-92c1-ca11375d7117 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:03.052417 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-229e99c2-3fa0-49dd-92c1-ca11375d7117 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:03.052933 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-229e99c2-3fa0-49dd-92c1-ca11375d7117 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:03.053434 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-229e99c2-3fa0-49dd-92c1-ca11375d7117 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:03.054274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-229e99c2-3fa0-49dd-92c1-ca11375d7117 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:03.054789 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-229e99c2-3fa0-49dd-92c1-ca11375d7117 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:03.055331 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-229e99c2-3fa0-49dd-92c1-ca11375d7117 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:03.148892 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-229e99c2-3fa0-49dd-92c1-ca11375d7117 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099985 Aug 26 18:30:03.148892 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 445/904] 10.222.0.45 () {58 vars in 1275 bytes} [Fri Aug 26 18:30:03 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:30:03.243170 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-12cbacf7-cb5c-4d31-b33a-36f4070cabcf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:03.243844 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-12cbacf7-cb5c-4d31-b33a-36f4070cabcf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:03.250237 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12cbacf7-cb5c-4d31-b33a-36f4070cabcf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:03.250836 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12cbacf7-cb5c-4d31-b33a-36f4070cabcf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:03.251351 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12cbacf7-cb5c-4d31-b33a-36f4070cabcf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:03.252120 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12cbacf7-cb5c-4d31-b33a-36f4070cabcf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:03.252610 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12cbacf7-cb5c-4d31-b33a-36f4070cabcf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:03.253126 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12cbacf7-cb5c-4d31-b33a-36f4070cabcf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:03.771718 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-12cbacf7-cb5c-4d31-b33a-36f4070cabcf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:03.781516 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-12cbacf7-cb5c-4d31-b33a-36f4070cabcf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:03.782965 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-12cbacf7-cb5c-4d31-b33a-36f4070cabcf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:03.784210 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-12cbacf7-cb5c-4d31-b33a-36f4070cabcf tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.545971 Aug 26 18:30:03.784815 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 460/905] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:30:03 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:30:04.489358 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-7c966700-b1df-416f-acd0-ca21f5bcb788 req-dd51f6e8-5f46-4d8b-b793-1871c359fd2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028c2a48-f55d-4b36-998a-ce813da73734", "tag": "ab9be478-b4ed-4055-9dae-990851a1722e"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:30:04.498933 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-7c966700-b1df-416f-acd0-ca21f5bcb788 req-dd51f6e8-5f46-4d8b-b793-1871c359fd2b service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:04.499394 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-7c966700-b1df-416f-acd0-ca21f5bcb788 req-dd51f6e8-5f46-4d8b-b793-1871c359fd2b service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:04.499829 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-7c966700-b1df-416f-acd0-ca21f5bcb788 req-dd51f6e8-5f46-4d8b-b793-1871c359fd2b service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:04.511546 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-7c966700-b1df-416f-acd0-ca21f5bcb788 req-dd51f6e8-5f46-4d8b-b793-1871c359fd2b service nova] Creating event network-changed:ab9be478-b4ed-4055-9dae-990851a1722e for instance 028c2a48-f55d-4b36-998a-ce813da73734 on hv-cinder-85199 Aug 26 18:30:04.516554 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-7c966700-b1df-416f-acd0-ca21f5bcb788 req-dd51f6e8-5f46-4d8b-b793-1871c359fd2b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031556 Aug 26 18:30:04.517445 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 446/906] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:04.807710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ca416120-66af-4543-a897-02bb07fb8f7a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:04.808984 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ca416120-66af-4543-a897-02bb07fb8f7a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:04.815999 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca416120-66af-4543-a897-02bb07fb8f7a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:04.816478 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca416120-66af-4543-a897-02bb07fb8f7a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:04.816964 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca416120-66af-4543-a897-02bb07fb8f7a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:04.817928 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca416120-66af-4543-a897-02bb07fb8f7a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:04.818557 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca416120-66af-4543-a897-02bb07fb8f7a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:04.819168 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca416120-66af-4543-a897-02bb07fb8f7a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:04.974096 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ca416120-66af-4543-a897-02bb07fb8f7a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:04.983583 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ca416120-66af-4543-a897-02bb07fb8f7a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:04.985847 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ca416120-66af-4543-a897-02bb07fb8f7a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:04.987071 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ca416120-66af-4543-a897-02bb07fb8f7a tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.183824 Aug 26 18:30:04.987630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 461/907] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:30:04 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:30:05.322725 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-9ab2b51f-b319-4c82-b18d-8acd6f7fed91 req-d30ec4e2-ec18-451a-bee0-7025d6df009f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82d25b8-bf09-48ca-9098-20bff440e163", "name": "network-vif-plugged", "status": "completed", "tag": "9120b3ad-b9e1-459d-b90c-56a0a48c2f3d"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:30:05.332398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-9ab2b51f-b319-4c82-b18d-8acd6f7fed91 req-d30ec4e2-ec18-451a-bee0-7025d6df009f service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:05.332923 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-9ab2b51f-b319-4c82-b18d-8acd6f7fed91 req-d30ec4e2-ec18-451a-bee0-7025d6df009f service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:05.333368 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-9ab2b51f-b319-4c82-b18d-8acd6f7fed91 req-d30ec4e2-ec18-451a-bee0-7025d6df009f service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:05.345736 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-9ab2b51f-b319-4c82-b18d-8acd6f7fed91 req-d30ec4e2-ec18-451a-bee0-7025d6df009f service nova] Creating event network-vif-plugged:9120b3ad-b9e1-459d-b90c-56a0a48c2f3d for instance f82d25b8-bf09-48ca-9098-20bff440e163 on hv-cinder-85199 Aug 26 18:30:05.350742 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-9ab2b51f-b319-4c82-b18d-8acd6f7fed91 req-d30ec4e2-ec18-451a-bee0-7025d6df009f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032159 Aug 26 18:30:05.351342 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 447/908] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:06.012478 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0f789c66-0513-4a31-b48a-1abed044cb91 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:06.013090 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0f789c66-0513-4a31-b48a-1abed044cb91 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:06.019962 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f789c66-0513-4a31-b48a-1abed044cb91 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:06.020446 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f789c66-0513-4a31-b48a-1abed044cb91 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:06.020920 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f789c66-0513-4a31-b48a-1abed044cb91 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:06.021623 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f789c66-0513-4a31-b48a-1abed044cb91 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:06.022075 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f789c66-0513-4a31-b48a-1abed044cb91 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:06.022501 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f789c66-0513-4a31-b48a-1abed044cb91 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:06.170561 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0f789c66-0513-4a31-b48a-1abed044cb91 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:06.178855 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0f789c66-0513-4a31-b48a-1abed044cb91 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:06.180262 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0f789c66-0513-4a31-b48a-1abed044cb91 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:06.181455 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0f789c66-0513-4a31-b48a-1abed044cb91 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.173801 Aug 26 18:30:06.182154 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 462/909] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:30:06 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:30:07.206651 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e618f6bb-f9e3-46f1-a2bc-8aab987493d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:07.207343 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e618f6bb-f9e3-46f1-a2bc-8aab987493d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:07.214567 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e618f6bb-f9e3-46f1-a2bc-8aab987493d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:07.215053 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e618f6bb-f9e3-46f1-a2bc-8aab987493d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:07.215489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e618f6bb-f9e3-46f1-a2bc-8aab987493d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:07.216183 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e618f6bb-f9e3-46f1-a2bc-8aab987493d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:07.216637 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e618f6bb-f9e3-46f1-a2bc-8aab987493d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:07.217102 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e618f6bb-f9e3-46f1-a2bc-8aab987493d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:07.363459 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e618f6bb-f9e3-46f1-a2bc-8aab987493d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:07.376320 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e618f6bb-f9e3-46f1-a2bc-8aab987493d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:07.378260 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e618f6bb-f9e3-46f1-a2bc-8aab987493d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:07.380240 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e618f6bb-f9e3-46f1-a2bc-8aab987493d7 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1730 microversion: 2.20 time: 0.178402 Aug 26 18:30:07.381300 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 448/910] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:30:07 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:30:07.931633 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5a9b98c8-521b-4f77-a9e1-30c6ea37e1b7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:07.933944 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5a9b98c8-521b-4f77-a9e1-30c6ea37e1b7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:07.940482 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9b98c8-521b-4f77-a9e1-30c6ea37e1b7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:07.940998 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9b98c8-521b-4f77-a9e1-30c6ea37e1b7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:07.941430 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9b98c8-521b-4f77-a9e1-30c6ea37e1b7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:07.942145 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9b98c8-521b-4f77-a9e1-30c6ea37e1b7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:07.942589 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9b98c8-521b-4f77-a9e1-30c6ea37e1b7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:07.942982 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9b98c8-521b-4f77-a9e1-30c6ea37e1b7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:07.978999 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5a9b98c8-521b-4f77-a9e1-30c6ea37e1b7 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051261 Aug 26 18:30:07.979560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 463/911] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:30:07 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:08.130599 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-68c22806-5a30-49fb-a7e1-bf938fb9e1b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:08.131202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-68c22806-5a30-49fb-a7e1-bf938fb9e1b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:08.133923 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:08.140379 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68c22806-5a30-49fb-a7e1-bf938fb9e1b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:08.140884 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68c22806-5a30-49fb-a7e1-bf938fb9e1b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:08.141305 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68c22806-5a30-49fb-a7e1-bf938fb9e1b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:08.141988 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68c22806-5a30-49fb-a7e1-bf938fb9e1b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:08.142426 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68c22806-5a30-49fb-a7e1-bf938fb9e1b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:08.142836 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68c22806-5a30-49fb-a7e1-bf938fb9e1b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:08.176668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-68c22806-5a30-49fb-a7e1-bf938fb9e1b8 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments/a3a47301-953d-469b-81b9-cc01423d1f2e" status: 200 len: 194 microversion: 2.1 time: 0.051856 Aug 26 18:30:08.177310 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 449/912] 10.222.0.45 () {58 vars in 1413 bytes} [Fri Aug 26 18:30:08 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments/a3a47301-953d-469b-81b9-cc01423d1f2e => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:08.188211 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-315a1c20-0693-4aea-a639-96e5235889c9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:08.188758 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-315a1c20-0693-4aea-a639-96e5235889c9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:08.194923 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-315a1c20-0693-4aea-a639-96e5235889c9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:08.195413 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-315a1c20-0693-4aea-a639-96e5235889c9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:08.195848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-315a1c20-0693-4aea-a639-96e5235889c9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:08.196539 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-315a1c20-0693-4aea-a639-96e5235889c9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:08.197026 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-315a1c20-0693-4aea-a639-96e5235889c9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:08.197452 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-315a1c20-0693-4aea-a639-96e5235889c9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:08.281830 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-315a1c20-0693-4aea-a639-96e5235889c9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lazy-loading 'services' on Instance uuid b64b2c53-9597-4ccd-bb49-9fdf93a2c329 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:30:08.355791 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-315a1c20-0693-4aea-a639-96e5235889c9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments/a3a47301-953d-469b-81b9-cc01423d1f2e" status: 202 len: 0 microversion: 2.1 time: 0.171525 Aug 26 18:30:08.356374 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 464/913] 10.222.0.45 () {58 vars in 1416 bytes} [Fri Aug 26 18:30:08 2022] DELETE /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments/a3a47301-953d-469b-81b9-cc01423d1f2e => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:30:08.406450 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-5eb5b412-ec7d-4e7a-b990-38e9385ff8e1 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:08.407451 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-5eb5b412-ec7d-4e7a-b990-38e9385ff8e1 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:08.420990 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5eb5b412-ec7d-4e7a-b990-38e9385ff8e1 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:08.422199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5eb5b412-ec7d-4e7a-b990-38e9385ff8e1 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:08.424705 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5eb5b412-ec7d-4e7a-b990-38e9385ff8e1 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:08.426527 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5eb5b412-ec7d-4e7a-b990-38e9385ff8e1 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:08.428234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5eb5b412-ec7d-4e7a-b990-38e9385ff8e1 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:08.429310 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5eb5b412-ec7d-4e7a-b990-38e9385ff8e1 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:08.738016 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5eb5b412-ec7d-4e7a-b990-38e9385ff8e1 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:08.746559 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5eb5b412-ec7d-4e7a-b990-38e9385ff8e1 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:08.747993 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5eb5b412-ec7d-4e7a-b990-38e9385ff8e1 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:08.749269 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-5eb5b412-ec7d-4e7a-b990-38e9385ff8e1 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1717 microversion: 2.20 time: 0.349238 Aug 26 18:30:08.750025 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 450/914] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:30:08 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1717 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:30:10.559669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7871afef-79d8-4d76-8ebd-f2182eb3d957 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:10.560232 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7871afef-79d8-4d76-8ebd-f2182eb3d957 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:10.567116 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7871afef-79d8-4d76-8ebd-f2182eb3d957 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:10.567905 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7871afef-79d8-4d76-8ebd-f2182eb3d957 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:10.568346 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7871afef-79d8-4d76-8ebd-f2182eb3d957 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:10.569095 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7871afef-79d8-4d76-8ebd-f2182eb3d957 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:10.569615 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7871afef-79d8-4d76-8ebd-f2182eb3d957 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:10.569993 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7871afef-79d8-4d76-8ebd-f2182eb3d957 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:10.609402 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7871afef-79d8-4d76-8ebd-f2182eb3d957 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments/3fe03495-a77a-46a8-822b-6babe4cfb170" status: 200 len: 194 microversion: 2.1 time: 0.054793 Aug 26 18:30:10.610059 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 465/915] 10.222.0.45 () {58 vars in 1413 bytes} [Fri Aug 26 18:30:10 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments/3fe03495-a77a-46a8-822b-6babe4cfb170 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:10.620965 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4ef1fa5a-2580-48fa-97c4-01e82fbbf8c6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:10.621543 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4ef1fa5a-2580-48fa-97c4-01e82fbbf8c6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:10.628355 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4ef1fa5a-2580-48fa-97c4-01e82fbbf8c6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:10.628896 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4ef1fa5a-2580-48fa-97c4-01e82fbbf8c6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:10.629339 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4ef1fa5a-2580-48fa-97c4-01e82fbbf8c6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:10.630038 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4ef1fa5a-2580-48fa-97c4-01e82fbbf8c6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:10.630483 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4ef1fa5a-2580-48fa-97c4-01e82fbbf8c6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:10.630897 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4ef1fa5a-2580-48fa-97c4-01e82fbbf8c6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:10.714577 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-4ef1fa5a-2580-48fa-97c4-01e82fbbf8c6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lazy-loading 'services' on Instance uuid b64b2c53-9597-4ccd-bb49-9fdf93a2c329 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:30:10.795926 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4ef1fa5a-2580-48fa-97c4-01e82fbbf8c6 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments/3fe03495-a77a-46a8-822b-6babe4cfb170" status: 202 len: 0 microversion: 2.1 time: 0.178920 Aug 26 18:30:10.796738 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 451/916] 10.222.0.45 () {58 vars in 1416 bytes} [Fri Aug 26 18:30:10 2022] DELETE /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments/3fe03495-a77a-46a8-822b-6babe4cfb170 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 18:30:11.978267 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0b4731bb-4cca-4408-acb4-b9d81e3722ba tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:11.980501 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0b4731bb-4cca-4408-acb4-b9d81e3722ba tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:11.987232 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b4731bb-4cca-4408-acb4-b9d81e3722ba tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:11.987715 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b4731bb-4cca-4408-acb4-b9d81e3722ba tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:11.988146 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b4731bb-4cca-4408-acb4-b9d81e3722ba tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:11.988860 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b4731bb-4cca-4408-acb4-b9d81e3722ba tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:11.989337 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b4731bb-4cca-4408-acb4-b9d81e3722ba tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:11.989756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b4731bb-4cca-4408-acb4-b9d81e3722ba tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:11.993633 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:12.020134 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0b4731bb-4cca-4408-acb4-b9d81e3722ba tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045760 Aug 26 18:30:12.020683 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 466/917] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:30:11 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 18:30:12.134773 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9ff87b2a-35ad-483e-b770-67e7ae85a737 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:12.137095 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9ff87b2a-35ad-483e-b770-67e7ae85a737 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:12.145206 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9ff87b2a-35ad-483e-b770-67e7ae85a737 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:12.145774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9ff87b2a-35ad-483e-b770-67e7ae85a737 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:12.146199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9ff87b2a-35ad-483e-b770-67e7ae85a737 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:12.146894 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9ff87b2a-35ad-483e-b770-67e7ae85a737 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:12.147333 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9ff87b2a-35ad-483e-b770-67e7ae85a737 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:12.147743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9ff87b2a-35ad-483e-b770-67e7ae85a737 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:12.177826 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9ff87b2a-35ad-483e-b770-67e7ae85a737 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047194 Aug 26 18:30:12.178385 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 452/918] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:30:12 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 18:30:12.239829 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2bf58224-e342-40f9-9be9-8790f9fbb4de tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:12.240606 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2bf58224-e342-40f9-9be9-8790f9fbb4de tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:12.246759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bf58224-e342-40f9-9be9-8790f9fbb4de tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:12.247616 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bf58224-e342-40f9-9be9-8790f9fbb4de tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:12.248045 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bf58224-e342-40f9-9be9-8790f9fbb4de tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:12.248980 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bf58224-e342-40f9-9be9-8790f9fbb4de tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:12.249657 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bf58224-e342-40f9-9be9-8790f9fbb4de tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:12.249843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bf58224-e342-40f9-9be9-8790f9fbb4de tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:12.275115 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2bf58224-e342-40f9-9be9-8790f9fbb4de tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:30:12.357371 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2bf58224-e342-40f9-9be9-8790f9fbb4de tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 204 len: 0 microversion: 2.1 time: 0.121100 Aug 26 18:30:12.358178 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 467/919] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:30:12 2022] DELETE /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:30:12.367040 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-670d4b7d-f0db-413e-9b88-a6fa43006d61 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:12.368004 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-670d4b7d-f0db-413e-9b88-a6fa43006d61 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:12.374510 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-670d4b7d-f0db-413e-9b88-a6fa43006d61 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:12.375027 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-670d4b7d-f0db-413e-9b88-a6fa43006d61 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:12.375460 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-670d4b7d-f0db-413e-9b88-a6fa43006d61 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:12.376155 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-670d4b7d-f0db-413e-9b88-a6fa43006d61 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:12.376602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-670d4b7d-f0db-413e-9b88-a6fa43006d61 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:12.377061 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-670d4b7d-f0db-413e-9b88-a6fa43006d61 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:12.381216 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:12.509905 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-670d4b7d-f0db-413e-9b88-a6fa43006d61 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:12.518169 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-670d4b7d-f0db-413e-9b88-a6fa43006d61 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1673 microversion: 2.1 time: 0.155498 Aug 26 18:30:12.520671 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 453/920] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:30:12 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:13.540293 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1ff8ae99-9bb0-4e9b-8cef-d4dfb0bb99bb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:13.541033 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1ff8ae99-9bb0-4e9b-8cef-d4dfb0bb99bb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:13.547686 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ff8ae99-9bb0-4e9b-8cef-d4dfb0bb99bb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:13.548166 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ff8ae99-9bb0-4e9b-8cef-d4dfb0bb99bb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:13.548603 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ff8ae99-9bb0-4e9b-8cef-d4dfb0bb99bb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:13.549337 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ff8ae99-9bb0-4e9b-8cef-d4dfb0bb99bb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:13.549789 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ff8ae99-9bb0-4e9b-8cef-d4dfb0bb99bb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:13.550214 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ff8ae99-9bb0-4e9b-8cef-d4dfb0bb99bb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:13.692480 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1ff8ae99-9bb0-4e9b-8cef-d4dfb0bb99bb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:13.700667 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1ff8ae99-9bb0-4e9b-8cef-d4dfb0bb99bb tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1673 microversion: 2.1 time: 0.164658 Aug 26 18:30:13.701273 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 468/921] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:30:13 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:14.721904 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e1e12861-551a-4cf7-b745-7676ca21366c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:14.722485 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e1e12861-551a-4cf7-b745-7676ca21366c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:14.729916 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e1e12861-551a-4cf7-b745-7676ca21366c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:14.730438 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e1e12861-551a-4cf7-b745-7676ca21366c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:14.731240 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e1e12861-551a-4cf7-b745-7676ca21366c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:14.732266 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e1e12861-551a-4cf7-b745-7676ca21366c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:14.732880 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e1e12861-551a-4cf7-b745-7676ca21366c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:14.733368 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e1e12861-551a-4cf7-b745-7676ca21366c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:14.960448 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e1e12861-551a-4cf7-b745-7676ca21366c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85158030e4904eab877dc5da3a6bbd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd848c03af214b948ab01dee79cb7c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:14.969476 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e1e12861-551a-4cf7-b745-7676ca21366c tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 200 len: 1673 microversion: 2.1 time: 0.251505 Aug 26 18:30:14.970202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 454/922] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:30:14 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 1673 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:15.175235 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-c4411e3b-fcea-4530-8f9c-a185ba0b4a9d req-3c9cc89c-3b02-417b-a31d-f309959be233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64b2c53-9597-4ccd-bb49-9fdf93a2c329", "name": "network-vif-deleted", "tag": "a8354f77-3734-470c-82e7-511d8aeb71c2"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:30:15.185316 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-c4411e3b-fcea-4530-8f9c-a185ba0b4a9d req-3c9cc89c-3b02-417b-a31d-f309959be233 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:15.185796 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-c4411e3b-fcea-4530-8f9c-a185ba0b4a9d req-3c9cc89c-3b02-417b-a31d-f309959be233 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:15.186352 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-c4411e3b-fcea-4530-8f9c-a185ba0b4a9d req-3c9cc89c-3b02-417b-a31d-f309959be233 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:15.199808 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-c4411e3b-fcea-4530-8f9c-a185ba0b4a9d req-3c9cc89c-3b02-417b-a31d-f309959be233 service nova] Creating event network-vif-deleted:a8354f77-3734-470c-82e7-511d8aeb71c2 for instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 on hv-cinder-85199 Aug 26 18:30:15.205350 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-c4411e3b-fcea-4530-8f9c-a185ba0b4a9d req-3c9cc89c-3b02-417b-a31d-f309959be233 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033834 Aug 26 18:30:15.206388 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 469/923] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:15.990855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-550d3e98-3cf1-4ee6-8a22-68d89c1660d4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:15.992326 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-550d3e98-3cf1-4ee6-8a22-68d89c1660d4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:15.999785 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-550d3e98-3cf1-4ee6-8a22-68d89c1660d4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:16.000325 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-550d3e98-3cf1-4ee6-8a22-68d89c1660d4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:16.000755 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-550d3e98-3cf1-4ee6-8a22-68d89c1660d4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:16.001532 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-550d3e98-3cf1-4ee6-8a22-68d89c1660d4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:16.001979 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-550d3e98-3cf1-4ee6-8a22-68d89c1660d4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:16.002402 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-550d3e98-3cf1-4ee6-8a22-68d89c1660d4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:16.018419 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-550d3e98-3cf1-4ee6-8a22-68d89c1660d4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] HTTP exception thrown: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-550d3e98-3cf1-4ee6-8a22-68d89c1660d4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Request method failure captured: Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 HTTP/1.1 Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ-wY72LHC3HbogcNq8IsRgSTdquEdc25Sd_AymXE_yPvTf3rJTQxS04xShW7S9PO9wZrSSqTaOR91AlrDoB7dQUozLOpOqPi045raet5Y7P0k_bJi8JCCndvP3WvGkowaXi1Os_FJ1SXihOBzlx9foNqfd6-IbV7Spl58jOB54xpPI Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: dd848c03af214b948ab01dee79cb7c34 Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:30:16.020160 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:30:16.021904 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dd848c03af214b948ab01dee79cb7c34", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dd848c03af214b948ab01dee79cb7c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dd848c03af214b948ab01dee79cb7c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dd848c03af214b948ab01dee79cb7c34"}]}] Aug 26 18:30:16.021904 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:30:16.021904 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: dd848c03af214b948ab01dee79cb7c34 Aug 26 18:30:16.021904 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:30:16.021904 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-AttachVolumeTestJSON-1312245293-project Aug 26 18:30:16.021904 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:30:16.021904 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:30:16.021904 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: 85158030e4904eab877dc5da3a6bbd33 Aug 26 18:30:16.021904 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-AttachVolumeTestJSON-1312245293-project Aug 26 18:30:16.021904 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:30:16.021904 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. Aug 26 18:30:16.021904 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': 'b64b2c53-9597-4ccd-bb49-9fdf93a2c329'} Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:30:16.022855 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. Aug 26 18:30:16.024475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:16.025822 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-550d3e98-3cf1-4ee6-8a22-68d89c1660d4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Returning 404 to user: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:30:16.025822 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-550d3e98-3cf1-4ee6-8a22-68d89c1660d4 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 404 len: 111 microversion: 2.1 time: 0.034736 Aug 26 18:30:16.025822 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 455/924] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:30:15 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:30:16.032153 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-619fbb28-e7f7-4ba0-8830-57e88abfd9ff tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '.version_select at 0x7fc744100040>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:16.055060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-619fbb28-e7f7-4ba0-8830-57e88abfd9ff tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355319377" status: 202 len: 0 microversion: 2.1 time: 0.027633 Aug 26 18:30:16.055678 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 470/925] 10.222.0.45 () {58 vars in 1221 bytes} [Fri Aug 26 18:30:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355319377 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:30:18.960790 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-fdf1c740-7bc6-4a60-9b1b-9e1813856340 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:18.961279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-fdf1c740-7bc6-4a60-9b1b-9e1813856340 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:18.968342 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdf1c740-7bc6-4a60-9b1b-9e1813856340 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:18.968832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdf1c740-7bc6-4a60-9b1b-9e1813856340 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:18.969455 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdf1c740-7bc6-4a60-9b1b-9e1813856340 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:18.970217 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdf1c740-7bc6-4a60-9b1b-9e1813856340 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:18.970614 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdf1c740-7bc6-4a60-9b1b-9e1813856340 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:18.971004 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdf1c740-7bc6-4a60-9b1b-9e1813856340 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:18.986860 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-fdf1c740-7bc6-4a60-9b1b-9e1813856340 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] HTTP exception thrown: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-fdf1c740-7bc6-4a60-9b1b-9e1813856340 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Request method failure captured: Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: DELETE /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 HTTP/1.1 Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ-wY72LHC3HbogcNq8IsRgSTdquEdc25Sd_AymXE_yPvTf3rJTQxS04xShW7S9PO9wZrSSqTaOR91AlrDoB7dQUozLOpOqPi045raet5Y7P0k_bJi8JCCndvP3WvGkowaXi1Os_FJ1SXihOBzlx9foNqfd6-IbV7Spl58jOB54xpPI Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: dd848c03af214b948ab01dee79cb7c34 Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:30:18.988432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:30:18.990179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dd848c03af214b948ab01dee79cb7c34", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dd848c03af214b948ab01dee79cb7c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dd848c03af214b948ab01dee79cb7c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dd848c03af214b948ab01dee79cb7c34"}]}] Aug 26 18:30:18.990179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:30:18.990179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: dd848c03af214b948ab01dee79cb7c34 Aug 26 18:30:18.990179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:30:18.990179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-AttachVolumeTestJSON-1312245293-project Aug 26 18:30:18.990179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:30:18.990179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:30:18.990179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: 85158030e4904eab877dc5da3a6bbd33 Aug 26 18:30:18.990179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-AttachVolumeTestJSON-1312245293-project Aug 26 18:30:18.990179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:30:18.990179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. Aug 26 18:30:18.990179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': 'b64b2c53-9597-4ccd-bb49-9fdf93a2c329'} Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:30:18.991062 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. Aug 26 18:30:18.992618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:18.994163 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-fdf1c740-7bc6-4a60-9b1b-9e1813856340 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Returning 404 to user: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:30:18.994163 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-fdf1c740-7bc6-4a60-9b1b-9e1813856340 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 404 len: 111 microversion: 2.1 time: 0.036706 Aug 26 18:30:18.994163 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 456/926] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:30:18 2022] DELETE /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:30:19.001406 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0184e623-e236-4c75-84c9-e547e18eef7f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:19.002139 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0184e623-e236-4c75-84c9-e547e18eef7f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: b64b2c53-9597-4ccd-bb49-9fdf93a2c329] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:19.010193 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0184e623-e236-4c75-84c9-e547e18eef7f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:19.011797 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0184e623-e236-4c75-84c9-e547e18eef7f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:19.012313 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0184e623-e236-4c75-84c9-e547e18eef7f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:19.012964 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0184e623-e236-4c75-84c9-e547e18eef7f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:19.013800 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0184e623-e236-4c75-84c9-e547e18eef7f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:19.014465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0184e623-e236-4c75-84c9-e547e18eef7f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:19.028759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-0184e623-e236-4c75-84c9-e547e18eef7f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] HTTP exception thrown: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0184e623-e236-4c75-84c9-e547e18eef7f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Request method failure captured: Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 HTTP/1.1 Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ-wY72LHC3HbogcNq8IsRgSTdquEdc25Sd_AymXE_yPvTf3rJTQxS04xShW7S9PO9wZrSSqTaOR91AlrDoB7dQUozLOpOqPi045raet5Y7P0k_bJi8JCCndvP3WvGkowaXi1Os_FJ1SXihOBzlx9foNqfd6-IbV7Spl58jOB54xpPI Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: dd848c03af214b948ab01dee79cb7c34 Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:30:19.031089 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:30:19.032756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dd848c03af214b948ab01dee79cb7c34", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dd848c03af214b948ab01dee79cb7c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dd848c03af214b948ab01dee79cb7c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dd848c03af214b948ab01dee79cb7c34"}]}] Aug 26 18:30:19.032756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:30:19.032756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: dd848c03af214b948ab01dee79cb7c34 Aug 26 18:30:19.032756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:30:19.032756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeTestJSON-1312245293-project Aug 26 18:30:19.032756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:30:19.032756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:30:19.032756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: 85158030e4904eab877dc5da3a6bbd33 Aug 26 18:30:19.032756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeTestJSON-1312245293-project Aug 26 18:30:19.032756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:30:19.032756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. Aug 26 18:30:19.032756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': 'b64b2c53-9597-4ccd-bb49-9fdf93a2c329'} Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:30:19.033751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. Aug 26 18:30:19.035192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:19.036549 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0184e623-e236-4c75-84c9-e547e18eef7f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Returning 404 to user: Instance b64b2c53-9597-4ccd-bb49-9fdf93a2c329 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:30:19.036549 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0184e623-e236-4c75-84c9-e547e18eef7f tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329" status: 404 len: 111 microversion: 2.1 time: 0.034938 Aug 26 18:30:19.036549 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 471/927] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:30:18 2022] GET /compute/v2.1/servers/b64b2c53-9597-4ccd-bb49-9fdf93a2c329 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:30:20.186723 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-14a0807e-b4e0-4ae3-956c-224e35ec91b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:20.187219 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-14a0807e-b4e0-4ae3-956c-224e35ec91b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:20.195129 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-14a0807e-b4e0-4ae3-956c-224e35ec91b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:20.195626 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-14a0807e-b4e0-4ae3-956c-224e35ec91b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:20.196064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-14a0807e-b4e0-4ae3-956c-224e35ec91b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:20.196823 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-14a0807e-b4e0-4ae3-956c-224e35ec91b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:20.197278 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-14a0807e-b4e0-4ae3-956c-224e35ec91b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:20.197707 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-14a0807e-b4e0-4ae3-956c-224e35ec91b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:20.212311 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-14a0807e-b4e0-4ae3-956c-224e35ec91b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] HTTP exception thrown: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-14a0807e-b4e0-4ae3-956c-224e35ec91b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Request method failure captured: Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: DELETE /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 HTTP/1.1 Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ-wY72LHC3HbogcNq8IsRgSTdquEdc25Sd_AymXE_yPvTf3rJTQxS04xShW7S9PO9wZrSSqTaOR91AlrDoB7dQUozLOpOqPi045raet5Y7P0k_bJi8JCCndvP3WvGkowaXi1Os_FJ1SXihOBzlx9foNqfd6-IbV7Spl58jOB54xpPI Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: dd848c03af214b948ab01dee79cb7c34 Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:30:20.213932 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:30:20.215496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dd848c03af214b948ab01dee79cb7c34", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dd848c03af214b948ab01dee79cb7c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dd848c03af214b948ab01dee79cb7c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dd848c03af214b948ab01dee79cb7c34"}]}] Aug 26 18:30:20.215496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:30:20.215496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: dd848c03af214b948ab01dee79cb7c34 Aug 26 18:30:20.215496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:30:20.215496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-AttachVolumeTestJSON-1312245293-project Aug 26 18:30:20.215496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:30:20.215496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:30:20.215496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: 85158030e4904eab877dc5da3a6bbd33 Aug 26 18:30:20.215496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-AttachVolumeTestJSON-1312245293-project Aug 26 18:30:20.215496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:30:20.215496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. Aug 26 18:30:20.215496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '024e8a0f-0670-4aec-8ec6-e8afbc67d464'} Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:30:20.216351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. Aug 26 18:30:20.217750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:20.219370 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-14a0807e-b4e0-4ae3-956c-224e35ec91b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Returning 404 to user: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:30:20.219370 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-14a0807e-b4e0-4ae3-956c-224e35ec91b9 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "DELETE /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 404 len: 111 microversion: 2.1 time: 0.032671 Aug 26 18:30:20.219370 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 457/928] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:30:20 2022] DELETE /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:30:20.224096 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6ca71093-4014-47fd-86a1-5a3a6a539086 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:20.224757 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6ca71093-4014-47fd-86a1-5a3a6a539086 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] [instance: 024e8a0f-0670-4aec-8ec6-e8afbc67d464] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:20.231380 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ca71093-4014-47fd-86a1-5a3a6a539086 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:20.231891 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ca71093-4014-47fd-86a1-5a3a6a539086 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:20.232327 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ca71093-4014-47fd-86a1-5a3a6a539086 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:20.233066 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ca71093-4014-47fd-86a1-5a3a6a539086 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:20.233518 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ca71093-4014-47fd-86a1-5a3a6a539086 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:20.233969 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ca71093-4014-47fd-86a1-5a3a6a539086 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:20.247362 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-6ca71093-4014-47fd-86a1-5a3a6a539086 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] HTTP exception thrown: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6ca71093-4014-47fd-86a1-5a3a6a539086 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Request method failure captured: Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 HTTP/1.1 Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ-wY72LHC3HbogcNq8IsRgSTdquEdc25Sd_AymXE_yPvTf3rJTQxS04xShW7S9PO9wZrSSqTaOR91AlrDoB7dQUozLOpOqPi045raet5Y7P0k_bJi8JCCndvP3WvGkowaXi1Os_FJ1SXihOBzlx9foNqfd6-IbV7Spl58jOB54xpPI Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: dd848c03af214b948ab01dee79cb7c34 Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:30:20.249062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:30:20.250651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dd848c03af214b948ab01dee79cb7c34", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dd848c03af214b948ab01dee79cb7c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dd848c03af214b948ab01dee79cb7c34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dd848c03af214b948ab01dee79cb7c34"}]}] Aug 26 18:30:20.250651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:30:20.250651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: dd848c03af214b948ab01dee79cb7c34 Aug 26 18:30:20.250651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1312245293 Aug 26 18:30:20.250651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeTestJSON-1312245293-project Aug 26 18:30:20.250651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:30:20.250651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:30:20.250651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: 85158030e4904eab877dc5da3a6bbd33 Aug 26 18:30:20.250651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeTestJSON-1312245293-project Aug 26 18:30:20.250651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:30:20.250651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. Aug 26 18:30:20.250651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': '024e8a0f-0670-4aec-8ec6-e8afbc67d464'} Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:30:20.251621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. Aug 26 18:30:20.253227 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:20.254656 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6ca71093-4014-47fd-86a1-5a3a6a539086 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] Returning 404 to user: Instance 024e8a0f-0670-4aec-8ec6-e8afbc67d464 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:30:20.254656 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6ca71093-4014-47fd-86a1-5a3a6a539086 tempest-AttachVolumeTestJSON-1312245293 tempest-AttachVolumeTestJSON-1312245293-project] 10.222.0.45 "GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464" status: 404 len: 111 microversion: 2.1 time: 0.030340 Aug 26 18:30:20.254656 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 472/929] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:30:20 2022] GET /compute/v2.1/servers/024e8a0f-0670-4aec-8ec6-e8afbc67d464 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:30:26.162870 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7f04ec81-c02b-4d3a-a2db-456fe0b89f47 tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] Calling method '.version_select at 0x7fc7440323a0>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:26.216330 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-7f04ec81-c02b-4d3a-a2db-456fe0b89f47 tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8e986b61-44d5-44c3-b5aa-5b52eea60105" status: 200 len: 351 microversion: 2.1 time: 0.057343 Aug 26 18:30:26.217178 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 458/930] 10.222.0.45 () {58 vars in 1245 bytes} [Fri Aug 26 18:30:26 2022] GET /compute/v2.1/os-volumes/8e986b61-44d5-44c3-b5aa-5b52eea60105 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:27.592363 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0563b989-3c51-472a-b14a-713dfcb97efe tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] Calling method '.version_select at 0x7fc744229b80>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:27.649780 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0563b989-3c51-472a-b14a-713dfcb97efe tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/05bd7338-002b-41e2-bc33-b73dcb29ad98" status: 200 len: 350 microversion: 2.1 time: 0.063889 Aug 26 18:30:27.650356 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 473/931] 10.222.0.45 () {58 vars in 1245 bytes} [Fri Aug 26 18:30:27 2022] GET /compute/v2.1/os-volumes/05bd7338-002b-41e2-bc33-b73dcb29ad98 => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:29.000645 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e57fb83c-9063-47a9-93e2-9452951e2aca tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] Calling method '.version_select at 0x7fc744075040>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:29.060044 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e57fb83c-9063-47a9-93e2-9452951e2aca tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/88f1e29c-f928-4db4-8bb3-59f8adf1fb37" status: 200 len: 351 microversion: 2.1 time: 0.064023 Aug 26 18:30:29.060609 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 459/932] 10.222.0.45 () {58 vars in 1245 bytes} [Fri Aug 26 18:30:28 2022] GET /compute/v2.1/os-volumes/88f1e29c-f928-4db4-8bb3-59f8adf1fb37 => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:29.074178 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-07bac7af-4f48-4f69-9ceb-d00f8b7026e1 tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] Calling method '.version_select at 0x7fc744100b80>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:29.164974 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-07bac7af-4f48-4f69-9ceb-d00f8b7026e1 tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.094995 Aug 26 18:30:29.165542 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 474/933] 10.222.0.45 () {58 vars in 1134 bytes} [Fri Aug 26 18:30:29 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:29.179921 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-18eac87c-86a4-4f52-98f5-a835b8f462ae tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] Calling method '.version_select at 0x7fc73ffe0d30>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:29.264863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-18eac87c-86a4-4f52-98f5-a835b8f462ae tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088727 Aug 26 18:30:29.265438 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 460/934] 10.222.0.45 () {58 vars in 1149 bytes} [Fri Aug 26 18:30:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:29.278602 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-91ae60c5-133a-4529-b346-f088d4903bc3 tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] Calling method '.version_select at 0x7fc744236e50>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:29.362515 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-91ae60c5-133a-4529-b346-f088d4903bc3 tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087664 Aug 26 18:30:29.363113 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 475/935] 10.222.0.45 () {58 vars in 1134 bytes} [Fri Aug 26 18:30:29 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:29.375852 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1e6551b1-a870-4b7f-af84-edf5b21fc2cf tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] Calling method '.version_select at 0x7fc744032790>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:29.462034 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1e6551b1-a870-4b7f-af84-edf5b21fc2cf tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090000 Aug 26 18:30:29.462640 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 461/936] 10.222.0.45 () {58 vars in 1167 bytes} [Fri Aug 26 18:30:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:30:29.476406 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1ff03b17-6791-4028-bc38-dd5c67f5b7cf tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] Calling method '.version_select at 0x7fc744229160>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:29.560886 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1ff03b17-6791-4028-bc38-dd5c67f5b7cf tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088370 Aug 26 18:30:29.561590 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 476/937] 10.222.0.45 () {58 vars in 1170 bytes} [Fri Aug 26 18:30:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:29.574504 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-a2eb3941-cac4-4445-818d-d1032bc23c99 tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] Calling method '.version_select at 0x7fc7440e5670>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:29.659952 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-a2eb3941-cac4-4445-818d-d1032bc23c99 tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089109 Aug 26 18:30:29.660755 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 462/938] 10.222.0.45 () {58 vars in 1155 bytes} [Fri Aug 26 18:30:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:29.673539 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-669aee08-6e39-4594-ac84-87a58ab25302 tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] Calling method '.version_select at 0x7fc747abf670>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:29.759269 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-669aee08-6e39-4594-ac84-87a58ab25302 tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089552 Aug 26 18:30:29.759815 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 477/939] 10.222.0.45 () {58 vars in 1188 bytes} [Fri Aug 26 18:30:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:29.774770 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-fc9d836b-dc78-4598-8233-651928809677 tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] Calling method '.version_select at 0x7fc7441d6ee0>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:29.863679 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-fc9d836b-dc78-4598-8233-651928809677 tempest-VolumesTestJSON-1219135579 tempest-VolumesTestJSON-1219135579-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.094120 Aug 26 18:30:29.864249 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 463/940] 10.222.0.45 () {58 vars in 1155 bytes} [Fri Aug 26 18:30:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:42.338079 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:42.339042 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:42.343793 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-adac3085-93ef-4990-8431-af7c8ad1b77f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:42.344219 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-adac3085-93ef-4990-8431-af7c8ad1b77f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:42.352065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adac3085-93ef-4990-8431-af7c8ad1b77f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:42.352582 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adac3085-93ef-4990-8431-af7c8ad1b77f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:42.353067 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adac3085-93ef-4990-8431-af7c8ad1b77f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:42.353866 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adac3085-93ef-4990-8431-af7c8ad1b77f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:42.361025 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adac3085-93ef-4990-8431-af7c8ad1b77f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:42.361468 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adac3085-93ef-4990-8431-af7c8ad1b77f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:42.396355 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-adac3085-93ef-4990-8431-af7c8ad1b77f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734/ips" status: 200 len: 149 microversion: 2.1 time: 0.059749 Aug 26 18:30:42.402084 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 478/941] 10.222.0.45 () {58 vars in 1248 bytes} [Fri Aug 26 18:30:42 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734/ips => generated 149 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:42.932365 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=17 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:42.933296 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=16 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:43.244081 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-cdb4f5b3-fe13-48cd-97a3-6ab03164bd5e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Action: 'create', calling method: .version_select at 0x7fc7441f8e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1376437212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmvYsPTVhrVYMCQtq67jgDvp2CkhbUGIZbj9MWdIftXNU2vpgr4bO9gDl82CClY/N3N/LTusEaxL7ke/bWrSvu/7jYc2SmmotYj9V4cs40RmF6xBZpt7TkpxaUkUzDE2w=="}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:30:43.269244 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-cdb4f5b3-fe13-48cd-97a3-6ab03164bd5e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Getting quotas for project 2023d6404889439f8034ea56372395c1. Resources: {'key_pairs'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:30:43.274720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-cdb4f5b3-fe13-48cd-97a3-6ab03164bd5e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Getting quotas for user fd0921be36eb4388a8e3098f5fba3ee7 and project 2023d6404889439f8034ea56372395c1. Resources: {'key_pairs'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:30:43.302616 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-cdb4f5b3-fe13-48cd-97a3-6ab03164bd5e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.371448 Aug 26 18:30:43.303258 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 464/942] 10.222.0.45 () {60 vars in 1159 bytes} [Fri Aug 26 18:30:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:44.044484 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eba31d23-bc0b-4f18-9db8-c52fe09f55bf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9ec0e8b-c684-4ea0-96c0-c5c4be85ffee"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:30:44.046837 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eba31d23-bc0b-4f18-9db8-c52fe09f55bf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:44.057198 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eba31d23-bc0b-4f18-9db8-c52fe09f55bf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:44.057686 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eba31d23-bc0b-4f18-9db8-c52fe09f55bf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:44.058120 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eba31d23-bc0b-4f18-9db8-c52fe09f55bf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:44.058823 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eba31d23-bc0b-4f18-9db8-c52fe09f55bf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:44.059271 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eba31d23-bc0b-4f18-9db8-c52fe09f55bf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:44.059690 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eba31d23-bc0b-4f18-9db8-c52fe09f55bf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:44.407996 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eba31d23-bc0b-4f18-9db8-c52fe09f55bf tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "POST /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366978 Aug 26 18:30:44.410525 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 479/943] 10.222.0.45 () {60 vars in 1323 bytes} [Fri Aug 26 18:30:44 2022] POST /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:47.227307 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f43e4bf0-2558-4eb5-8523-0e0c3600a57c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:47.229888 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f43e4bf0-2558-4eb5-8523-0e0c3600a57c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:47.237199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f43e4bf0-2558-4eb5-8523-0e0c3600a57c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:47.237768 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f43e4bf0-2558-4eb5-8523-0e0c3600a57c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:47.238194 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f43e4bf0-2558-4eb5-8523-0e0c3600a57c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:47.239152 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f43e4bf0-2558-4eb5-8523-0e0c3600a57c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:47.239695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f43e4bf0-2558-4eb5-8523-0e0c3600a57c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:47.240123 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f43e4bf0-2558-4eb5-8523-0e0c3600a57c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:47.270048 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f43e4bf0-2558-4eb5-8523-0e0c3600a57c tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047733 Aug 26 18:30:47.270615 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 465/944] 10.222.0.45 () {60 vars in 1343 bytes} [Fri Aug 26 18:30:47 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:47.349049 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-996e99a6-49bd-4d7f-a5d5-14e45f27eb04 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:47.350213 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-996e99a6-49bd-4d7f-a5d5-14e45f27eb04 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:47.357571 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-996e99a6-49bd-4d7f-a5d5-14e45f27eb04 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:47.358415 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-996e99a6-49bd-4d7f-a5d5-14e45f27eb04 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:47.359143 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-996e99a6-49bd-4d7f-a5d5-14e45f27eb04 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:47.360058 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-996e99a6-49bd-4d7f-a5d5-14e45f27eb04 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:47.360688 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-996e99a6-49bd-4d7f-a5d5-14e45f27eb04 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:47.361332 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-996e99a6-49bd-4d7f-a5d5-14e45f27eb04 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:47.387588 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-996e99a6-49bd-4d7f-a5d5-14e45f27eb04 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:30:47.490020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-996e99a6-49bd-4d7f-a5d5-14e45f27eb04 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 204 len: 0 microversion: 2.20 time: 0.141962 Aug 26 18:30:47.490908 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 480/945] 10.222.0.45 () {60 vars in 1280 bytes} [Fri Aug 26 18:30:47 2022] DELETE /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 18:30:47.500209 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-791158a5-57f7-4e02-9586-bfd703ca10a0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:47.501111 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-791158a5-57f7-4e02-9586-bfd703ca10a0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:47.507406 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-791158a5-57f7-4e02-9586-bfd703ca10a0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:47.508154 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-791158a5-57f7-4e02-9586-bfd703ca10a0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:47.508831 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-791158a5-57f7-4e02-9586-bfd703ca10a0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:47.509741 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-791158a5-57f7-4e02-9586-bfd703ca10a0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:47.510349 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-791158a5-57f7-4e02-9586-bfd703ca10a0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:47.510761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-791158a5-57f7-4e02-9586-bfd703ca10a0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:47.656548 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-791158a5-57f7-4e02-9586-bfd703ca10a0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:47.666155 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-791158a5-57f7-4e02-9586-bfd703ca10a0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:47.667685 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-791158a5-57f7-4e02-9586-bfd703ca10a0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:47.669053 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-791158a5-57f7-4e02-9586-bfd703ca10a0 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.173597 Aug 26 18:30:47.671926 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 466/946] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:30:47 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 18:30:48.694622 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9dd4bd83-e65f-4656-a17d-54e6fc5ab1d8 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:48.695397 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9dd4bd83-e65f-4656-a17d-54e6fc5ab1d8 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:48.708062 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9dd4bd83-e65f-4656-a17d-54e6fc5ab1d8 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:48.708548 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9dd4bd83-e65f-4656-a17d-54e6fc5ab1d8 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:48.709219 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9dd4bd83-e65f-4656-a17d-54e6fc5ab1d8 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:48.709987 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9dd4bd83-e65f-4656-a17d-54e6fc5ab1d8 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:48.710439 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9dd4bd83-e65f-4656-a17d-54e6fc5ab1d8 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:48.710859 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9dd4bd83-e65f-4656-a17d-54e6fc5ab1d8 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:48.861768 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9dd4bd83-e65f-4656-a17d-54e6fc5ab1d8 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:48.870494 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9dd4bd83-e65f-4656-a17d-54e6fc5ab1d8 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:48.871980 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9dd4bd83-e65f-4656-a17d-54e6fc5ab1d8 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:48.873108 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9dd4bd83-e65f-4656-a17d-54e6fc5ab1d8 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1723 microversion: 2.20 time: 0.182967 Aug 26 18:30:48.873650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 481/947] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:30:48 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:30:49.793710 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-cfaa0f4f-7a26-4ba0-af06-dabd4660fe1d req-4e699741-650e-430d-acec-f8c405d20473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82d25b8-bf09-48ca-9098-20bff440e163", "name": "network-vif-deleted", "tag": "9120b3ad-b9e1-459d-b90c-56a0a48c2f3d"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:30:49.804538 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-cfaa0f4f-7a26-4ba0-af06-dabd4660fe1d req-4e699741-650e-430d-acec-f8c405d20473 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:49.806504 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-cfaa0f4f-7a26-4ba0-af06-dabd4660fe1d req-4e699741-650e-430d-acec-f8c405d20473 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:49.806952 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-cfaa0f4f-7a26-4ba0-af06-dabd4660fe1d req-4e699741-650e-430d-acec-f8c405d20473 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:49.819942 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-cfaa0f4f-7a26-4ba0-af06-dabd4660fe1d req-4e699741-650e-430d-acec-f8c405d20473 service nova] Creating event network-vif-deleted:9120b3ad-b9e1-459d-b90c-56a0a48c2f3d for instance f82d25b8-bf09-48ca-9098-20bff440e163 on hv-cinder-85199 Aug 26 18:30:49.828354 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-cfaa0f4f-7a26-4ba0-af06-dabd4660fe1d req-4e699741-650e-430d-acec-f8c405d20473 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038283 Aug 26 18:30:49.833396 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 467/948] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:49.897390 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3c58c8e1-ff01-4101-9d90-36a16f3217f4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:49.898875 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3c58c8e1-ff01-4101-9d90-36a16f3217f4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:49.908238 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c58c8e1-ff01-4101-9d90-36a16f3217f4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:49.912052 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c58c8e1-ff01-4101-9d90-36a16f3217f4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:49.914139 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c58c8e1-ff01-4101-9d90-36a16f3217f4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:49.915543 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c58c8e1-ff01-4101-9d90-36a16f3217f4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:49.916214 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c58c8e1-ff01-4101-9d90-36a16f3217f4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:49.916860 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c58c8e1-ff01-4101-9d90-36a16f3217f4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:50.051852 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3c58c8e1-ff01-4101-9d90-36a16f3217f4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:50.062020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3c58c8e1-ff01-4101-9d90-36a16f3217f4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:50.063857 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3c58c8e1-ff01-4101-9d90-36a16f3217f4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cde02839effc4354a4fd7e82c1dc8e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1167fc380043c5b04a6746d715003a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:50.065208 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3c58c8e1-ff01-4101-9d90-36a16f3217f4 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 200 len: 1366 microversion: 2.20 time: 0.173210 Aug 26 18:30:50.082149 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 482/949] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:30:49 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 18:30:51.093452 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-80998ad5-3ec5-45d8-b8e0-541c5f2113c9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:51.094274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-80998ad5-3ec5-45d8-b8e0-541c5f2113c9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:51.100606 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-80998ad5-3ec5-45d8-b8e0-541c5f2113c9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:51.101227 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-80998ad5-3ec5-45d8-b8e0-541c5f2113c9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:51.101727 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-80998ad5-3ec5-45d8-b8e0-541c5f2113c9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:51.102642 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-80998ad5-3ec5-45d8-b8e0-541c5f2113c9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:51.103089 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-80998ad5-3ec5-45d8-b8e0-541c5f2113c9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:51.103689 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-80998ad5-3ec5-45d8-b8e0-541c5f2113c9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:51.117228 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-80998ad5-3ec5-45d8-b8e0-541c5f2113c9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] HTTP exception thrown: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-80998ad5-3ec5-45d8-b8e0-541c5f2113c9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Request method failure captured: Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 HTTP/1.1 Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ-u8QOp5__8Yf7VkiKP3aGHvCdLBtDCcGlQC4PkhvU7w7Z_ut2VIjOIG6S8SGCK_QTLQXA-x4UgbDlTS8WaCG1SP-tnDR83EIrrD19Wkhngn5K58B7BD5uPSV1hrpZ9obmVH_ciV8K-xDUUFINTcE6IlnUqBf65YrnQPNolZgptxO4 Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 4e1167fc380043c5b04a6746d715003a Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:30:51.118901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:30:51.120404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4e1167fc380043c5b04a6746d715003a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4e1167fc380043c5b04a6746d715003a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4e1167fc380043c5b04a6746d715003a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4e1167fc380043c5b04a6746d715003a"}]}] Aug 26 18:30:51.120404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:30:51.120404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 4e1167fc380043c5b04a6746d715003a Aug 26 18:30:51.120404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:30:51.120404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-AttachVolumeShelveTestJSON-72087033-project Aug 26 18:30:51.120404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:30:51.120404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:30:51.120404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: cde02839effc4354a4fd7e82c1dc8e26 Aug 26 18:30:51.120404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72087033-project Aug 26 18:30:51.120404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:30:51.120404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. Aug 26 18:30:51.120404 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': 'f82d25b8-bf09-48ca-9098-20bff440e163'} Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:30:51.121250 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. Aug 26 18:30:51.122584 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:51.123712 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-80998ad5-3ec5-45d8-b8e0-541c5f2113c9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Returning 404 to user: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:30:51.123712 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-80998ad5-3ec5-45d8-b8e0-541c5f2113c9 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 404 len: 111 microversion: 2.20 time: 0.031690 Aug 26 18:30:51.123712 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 468/950] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:30:51 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 18:30:51.129334 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c3ac447b-3420-49af-b809-00c4bd1e4e45 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '.version_select at 0x7fc74410ea60>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:51.150705 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c3ac447b-3420-49af-b809-00c4bd1e4e45 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-639047670" status: 204 len: 0 microversion: 2.20 time: 0.025095 Aug 26 18:30:51.151284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 483/951] 10.222.0.45 () {60 vars in 1259 bytes} [Fri Aug 26 18:30:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-639047670 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 18:30:52.179218 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9ee3286a-8f33-47a9-98cf-1945f164f541 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:52.179795 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9ee3286a-8f33-47a9-98cf-1945f164f541 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:52.187954 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9ee3286a-8f33-47a9-98cf-1945f164f541 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:52.188898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9ee3286a-8f33-47a9-98cf-1945f164f541 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:52.189408 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9ee3286a-8f33-47a9-98cf-1945f164f541 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:52.190350 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9ee3286a-8f33-47a9-98cf-1945f164f541 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:52.190903 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9ee3286a-8f33-47a9-98cf-1945f164f541 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:52.191539 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9ee3286a-8f33-47a9-98cf-1945f164f541 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:52.280395 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-9ee3286a-8f33-47a9-98cf-1945f164f541 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lazy-loading 'services' on Instance uuid 028c2a48-f55d-4b36-998a-ce813da73734 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:30:52.353605 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9ee3286a-8f33-47a9-98cf-1945f164f541 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "DELETE /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734/os-volume_attachments/e9ec0e8b-c684-4ea0-96c0-c5c4be85ffee" status: 202 len: 0 microversion: 2.1 time: 0.179603 Aug 26 18:30:52.354211 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 469/952] 10.222.0.45 () {58 vars in 1416 bytes} [Fri Aug 26 18:30:52 2022] DELETE /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734/os-volume_attachments/e9ec0e8b-c684-4ea0-96c0-c5c4be85ffee => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:30:52.364252 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-24d79ab6-6592-49c9-99f7-9436237198b0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:52.366809 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-24d79ab6-6592-49c9-99f7-9436237198b0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:52.381868 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24d79ab6-6592-49c9-99f7-9436237198b0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:52.382844 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24d79ab6-6592-49c9-99f7-9436237198b0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:52.383651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24d79ab6-6592-49c9-99f7-9436237198b0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:52.384765 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24d79ab6-6592-49c9-99f7-9436237198b0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:52.385683 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24d79ab6-6592-49c9-99f7-9436237198b0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:52.386379 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24d79ab6-6592-49c9-99f7-9436237198b0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:52.421679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-24d79ab6-6592-49c9-99f7-9436237198b0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062214 Aug 26 18:30:52.422253 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 484/953] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:30:52 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:53.068037 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-644f761c-da6f-4394-9a10-14a064d686af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:53.069222 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-644f761c-da6f-4394-9a10-14a064d686af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:53.079656 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-644f761c-da6f-4394-9a10-14a064d686af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:53.080266 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-644f761c-da6f-4394-9a10-14a064d686af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:53.080850 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-644f761c-da6f-4394-9a10-14a064d686af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:53.082245 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-644f761c-da6f-4394-9a10-14a064d686af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:53.082854 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-644f761c-da6f-4394-9a10-14a064d686af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:53.083334 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-644f761c-da6f-4394-9a10-14a064d686af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:53.105115 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-644f761c-da6f-4394-9a10-14a064d686af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] HTTP exception thrown: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-644f761c-da6f-4394-9a10-14a064d686af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Request method failure captured: Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: DELETE /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 HTTP/1.1 Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ-u8QOp5__8Yf7VkiKP3aGHvCdLBtDCcGlQC4PkhvU7w7Z_ut2VIjOIG6S8SGCK_QTLQXA-x4UgbDlTS8WaCG1SP-tnDR83EIrrD19Wkhngn5K58B7BD5uPSV1hrpZ9obmVH_ciV8K-xDUUFINTcE6IlnUqBf65YrnQPNolZgptxO4 Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 4e1167fc380043c5b04a6746d715003a Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:30:53.107883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:30:53.111922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4e1167fc380043c5b04a6746d715003a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4e1167fc380043c5b04a6746d715003a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4e1167fc380043c5b04a6746d715003a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4e1167fc380043c5b04a6746d715003a"}]}] Aug 26 18:30:53.111922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:30:53.111922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 4e1167fc380043c5b04a6746d715003a Aug 26 18:30:53.111922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:30:53.111922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-AttachVolumeShelveTestJSON-72087033-project Aug 26 18:30:53.111922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:30:53.111922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:30:53.111922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: cde02839effc4354a4fd7e82c1dc8e26 Aug 26 18:30:53.111922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72087033-project Aug 26 18:30:53.111922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:30:53.111922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. Aug 26 18:30:53.111922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': 'f82d25b8-bf09-48ca-9098-20bff440e163'} Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:30:53.113545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. Aug 26 18:30:53.115964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:53.118667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-644f761c-da6f-4394-9a10-14a064d686af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Returning 404 to user: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:30:53.118667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-644f761c-da6f-4394-9a10-14a064d686af tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 404 len: 111 microversion: 2.20 time: 0.050451 Aug 26 18:30:53.118667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 470/954] 10.222.0.45 () {60 vars in 1280 bytes} [Fri Aug 26 18:30:53 2022] DELETE /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 18:30:53.123141 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-13b10529-dbdc-40db-90f9-d71f57557cae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:53.123759 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-13b10529-dbdc-40db-90f9-d71f57557cae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: f82d25b8-bf09-48ca-9098-20bff440e163] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:53.130046 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13b10529-dbdc-40db-90f9-d71f57557cae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:53.130626 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13b10529-dbdc-40db-90f9-d71f57557cae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:53.131125 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13b10529-dbdc-40db-90f9-d71f57557cae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:53.132035 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13b10529-dbdc-40db-90f9-d71f57557cae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:53.132695 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13b10529-dbdc-40db-90f9-d71f57557cae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:53.133339 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13b10529-dbdc-40db-90f9-d71f57557cae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:53.150124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-13b10529-dbdc-40db-90f9-d71f57557cae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] HTTP exception thrown: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-13b10529-dbdc-40db-90f9-d71f57557cae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Request method failure captured: Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 HTTP/1.1 Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ-u8QOp5__8Yf7VkiKP3aGHvCdLBtDCcGlQC4PkhvU7w7Z_ut2VIjOIG6S8SGCK_QTLQXA-x4UgbDlTS8WaCG1SP-tnDR83EIrrD19Wkhngn5K58B7BD5uPSV1hrpZ9obmVH_ciV8K-xDUUFINTcE6IlnUqBf65YrnQPNolZgptxO4 Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 4e1167fc380043c5b04a6746d715003a Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:30:53.151963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:30:53.154354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4e1167fc380043c5b04a6746d715003a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4e1167fc380043c5b04a6746d715003a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4e1167fc380043c5b04a6746d715003a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4e1167fc380043c5b04a6746d715003a"}]}] Aug 26 18:30:53.154354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:30:53.154354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 4e1167fc380043c5b04a6746d715003a Aug 26 18:30:53.154354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:30:53.154354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeShelveTestJSON-72087033-project Aug 26 18:30:53.154354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:30:53.154354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:30:53.154354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: cde02839effc4354a4fd7e82c1dc8e26 Aug 26 18:30:53.154354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72087033-project Aug 26 18:30:53.154354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:30:53.154354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. Aug 26 18:30:53.154354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': 'f82d25b8-bf09-48ca-9098-20bff440e163'} Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:30:53.157056 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. Aug 26 18:30:53.159774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:53.162558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-13b10529-dbdc-40db-90f9-d71f57557cae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Returning 404 to user: Instance f82d25b8-bf09-48ca-9098-20bff440e163 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:30:53.162558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-13b10529-dbdc-40db-90f9-d71f57557cae tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163" status: 404 len: 111 microversion: 2.20 time: 0.035833 Aug 26 18:30:53.162558 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 485/955] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:30:53 2022] GET /compute/v2.1/servers/f82d25b8-bf09-48ca-9098-20bff440e163 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 18:30:53.434357 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-3d5d0cc4-d800-446f-a5d3-b9241239c843 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:53.436705 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-3d5d0cc4-d800-446f-a5d3-b9241239c843 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:53.439291 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=4 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:30:53.445046 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d5d0cc4-d800-446f-a5d3-b9241239c843 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:53.445529 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d5d0cc4-d800-446f-a5d3-b9241239c843 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:53.445959 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d5d0cc4-d800-446f-a5d3-b9241239c843 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:53.446653 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d5d0cc4-d800-446f-a5d3-b9241239c843 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:53.447104 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d5d0cc4-d800-446f-a5d3-b9241239c843 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:53.447521 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d5d0cc4-d800-446f-a5d3-b9241239c843 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:53.477383 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-3d5d0cc4-d800-446f-a5d3-b9241239c843 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047019 Aug 26 18:30:53.478265 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 471/956] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:30:53 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 18:30:53.541211 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2a98887c-4137-4906-90d3-9f5425afbfce tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:53.541777 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2a98887c-4137-4906-90d3-9f5425afbfce tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:53.548134 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a98887c-4137-4906-90d3-9f5425afbfce tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:53.548605 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a98887c-4137-4906-90d3-9f5425afbfce tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:53.549065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a98887c-4137-4906-90d3-9f5425afbfce tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:53.549737 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a98887c-4137-4906-90d3-9f5425afbfce tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:53.550177 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a98887c-4137-4906-90d3-9f5425afbfce tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:53.550586 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a98887c-4137-4906-90d3-9f5425afbfce tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:53.589798 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2a98887c-4137-4906-90d3-9f5425afbfce tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:30:53.676164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2a98887c-4137-4906-90d3-9f5425afbfce tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "DELETE /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 204 len: 0 microversion: 2.1 time: 0.137750 Aug 26 18:30:53.677849 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 486/957] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:30:53 2022] DELETE /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:30:53.686872 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-cd978f03-5945-49be-be54-30d8301ca411 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:53.687420 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-cd978f03-5945-49be-be54-30d8301ca411 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:53.694272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cd978f03-5945-49be-be54-30d8301ca411 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:53.694781 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cd978f03-5945-49be-be54-30d8301ca411 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:53.695219 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cd978f03-5945-49be-be54-30d8301ca411 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:53.695902 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cd978f03-5945-49be-be54-30d8301ca411 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:53.696359 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cd978f03-5945-49be-be54-30d8301ca411 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:53.696800 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-cd978f03-5945-49be-be54-30d8301ca411 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:53.833649 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-cd978f03-5945-49be-be54-30d8301ca411 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:53.841596 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-cd978f03-5945-49be-be54-30d8301ca411 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1682 microversion: 2.1 time: 0.158657 Aug 26 18:30:53.842172 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 472/958] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:30:53 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:54.863934 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7260e230-1395-4076-a705-e679c0330ca1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:54.864677 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7260e230-1395-4076-a705-e679c0330ca1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:54.871545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7260e230-1395-4076-a705-e679c0330ca1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:54.872036 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7260e230-1395-4076-a705-e679c0330ca1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:54.872472 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7260e230-1395-4076-a705-e679c0330ca1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:54.873192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7260e230-1395-4076-a705-e679c0330ca1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:54.873673 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7260e230-1395-4076-a705-e679c0330ca1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:54.874097 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7260e230-1395-4076-a705-e679c0330ca1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:55.010324 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7260e230-1395-4076-a705-e679c0330ca1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:55.019954 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7260e230-1395-4076-a705-e679c0330ca1 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1682 microversion: 2.1 time: 0.160577 Aug 26 18:30:55.020505 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 487/959] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:30:54 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:56.045959 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-68da93b7-ebdc-4f64-accb-b88a03ef7567 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:56.047064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-68da93b7-ebdc-4f64-accb-b88a03ef7567 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:56.053719 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68da93b7-ebdc-4f64-accb-b88a03ef7567 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:56.054198 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68da93b7-ebdc-4f64-accb-b88a03ef7567 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:56.054966 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68da93b7-ebdc-4f64-accb-b88a03ef7567 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:56.055325 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68da93b7-ebdc-4f64-accb-b88a03ef7567 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:56.055779 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68da93b7-ebdc-4f64-accb-b88a03ef7567 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:56.056206 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68da93b7-ebdc-4f64-accb-b88a03ef7567 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:56.190998 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-68da93b7-ebdc-4f64-accb-b88a03ef7567 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:56.199098 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-68da93b7-ebdc-4f64-accb-b88a03ef7567 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1682 microversion: 2.1 time: 0.159675 Aug 26 18:30:56.199664 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 473/960] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:30:56 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:57.220577 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-64b3ddb1-dba0-42ca-b602-ffaa34cfb377 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:57.221772 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-64b3ddb1-dba0-42ca-b602-ffaa34cfb377 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:57.228585 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64b3ddb1-dba0-42ca-b602-ffaa34cfb377 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:57.229119 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64b3ddb1-dba0-42ca-b602-ffaa34cfb377 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:57.229561 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64b3ddb1-dba0-42ca-b602-ffaa34cfb377 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:57.230298 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64b3ddb1-dba0-42ca-b602-ffaa34cfb377 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:57.230724 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64b3ddb1-dba0-42ca-b602-ffaa34cfb377 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:57.231113 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64b3ddb1-dba0-42ca-b602-ffaa34cfb377 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:57.364849 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-64b3ddb1-dba0-42ca-b602-ffaa34cfb377 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:57.372777 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-64b3ddb1-dba0-42ca-b602-ffaa34cfb377 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1682 microversion: 2.1 time: 0.156067 Aug 26 18:30:57.373334 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 488/961] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:30:57 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:57.471578 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-36f62ecd-c3c7-46c6-958b-9ff2cf80b122 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:57.472121 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-36f62ecd-c3c7-46c6-958b-9ff2cf80b122 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:57.478701 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-36f62ecd-c3c7-46c6-958b-9ff2cf80b122 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:57.480319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-36f62ecd-c3c7-46c6-958b-9ff2cf80b122 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:57.480891 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-36f62ecd-c3c7-46c6-958b-9ff2cf80b122 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:57.481732 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-36f62ecd-c3c7-46c6-958b-9ff2cf80b122 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:57.482217 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-36f62ecd-c3c7-46c6-958b-9ff2cf80b122 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:57.483066 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-36f62ecd-c3c7-46c6-958b-9ff2cf80b122 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:57.496791 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-36f62ecd-c3c7-46c6-958b-9ff2cf80b122 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] HTTP exception thrown: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-36f62ecd-c3c7-46c6-958b-9ff2cf80b122 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Request method failure captured: Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: DELETE /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 HTTP/1.1 Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ-u8QOp5__8Yf7VkiKP3aGHvCdLBtDCcGlQC4PkhvU7w7Z_ut2VIjOIG6S8SGCK_QTLQXA-x4UgbDlTS8WaCG1SP-tnDR83EIrrD19Wkhngn5K58B7BD5uPSV1hrpZ9obmVH_ciV8K-xDUUFINTcE6IlnUqBf65YrnQPNolZgptxO4 Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 4e1167fc380043c5b04a6746d715003a Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:30:57.498377 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:30:57.499968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4e1167fc380043c5b04a6746d715003a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4e1167fc380043c5b04a6746d715003a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4e1167fc380043c5b04a6746d715003a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4e1167fc380043c5b04a6746d715003a"}]}] Aug 26 18:30:57.499968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:30:57.499968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 4e1167fc380043c5b04a6746d715003a Aug 26 18:30:57.499968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:30:57.499968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-AttachVolumeShelveTestJSON-72087033-project Aug 26 18:30:57.499968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:30:57.499968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:30:57.499968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: cde02839effc4354a4fd7e82c1dc8e26 Aug 26 18:30:57.499968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72087033-project Aug 26 18:30:57.499968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:30:57.499968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. Aug 26 18:30:57.499968 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '1ed32b7d-a792-49b2-84e7-962f4d537501'} Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:30:57.503898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. Aug 26 18:30:57.505384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:30:57.506804 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-36f62ecd-c3c7-46c6-958b-9ff2cf80b122 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Returning 404 to user: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:30:57.506804 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-36f62ecd-c3c7-46c6-958b-9ff2cf80b122 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 404 len: 111 microversion: 2.20 time: 0.032762 Aug 26 18:30:57.506804 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 474/962] 10.222.0.45 () {60 vars in 1280 bytes} [Fri Aug 26 18:30:57 2022] DELETE /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 18:30:57.508658 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0bcc7653-b7b9-40f3-894d-ecb4bc5ffb77 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:57.509320 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0bcc7653-b7b9-40f3-894d-ecb4bc5ffb77 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] [instance: 1ed32b7d-a792-49b2-84e7-962f4d537501] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:57.515773 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bcc7653-b7b9-40f3-894d-ecb4bc5ffb77 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:57.516243 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bcc7653-b7b9-40f3-894d-ecb4bc5ffb77 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:57.516676 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bcc7653-b7b9-40f3-894d-ecb4bc5ffb77 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:57.517492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bcc7653-b7b9-40f3-894d-ecb4bc5ffb77 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:57.517947 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bcc7653-b7b9-40f3-894d-ecb4bc5ffb77 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:57.518405 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bcc7653-b7b9-40f3-894d-ecb4bc5ffb77 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:57.533803 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-0bcc7653-b7b9-40f3-894d-ecb4bc5ffb77 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] HTTP exception thrown: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0bcc7653-b7b9-40f3-894d-ecb4bc5ffb77 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Request method failure captured: Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 HTTP/1.1 Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ-u8QOp5__8Yf7VkiKP3aGHvCdLBtDCcGlQC4PkhvU7w7Z_ut2VIjOIG6S8SGCK_QTLQXA-x4UgbDlTS8WaCG1SP-tnDR83EIrrD19Wkhngn5K58B7BD5uPSV1hrpZ9obmVH_ciV8K-xDUUFINTcE6IlnUqBf65YrnQPNolZgptxO4 Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 4e1167fc380043c5b04a6746d715003a Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:30:57.535506 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:30:57.536966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4e1167fc380043c5b04a6746d715003a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4e1167fc380043c5b04a6746d715003a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4e1167fc380043c5b04a6746d715003a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4e1167fc380043c5b04a6746d715003a"}]}] Aug 26 18:30:57.536966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:30:57.536966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 4e1167fc380043c5b04a6746d715003a Aug 26 18:30:57.536966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-72087033 Aug 26 18:30:57.536966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeShelveTestJSON-72087033-project Aug 26 18:30:57.536966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:30:57.536966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:30:57.536966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: cde02839effc4354a4fd7e82c1dc8e26 Aug 26 18:30:57.536966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeShelveTestJSON-72087033-project Aug 26 18:30:57.536966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:30:57.536966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. Aug 26 18:30:57.536966 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': '1ed32b7d-a792-49b2-84e7-962f4d537501'} Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:30:57.537884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. Aug 26 18:30:57.539231 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:30:57.540405 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0bcc7653-b7b9-40f3-894d-ecb4bc5ffb77 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] Returning 404 to user: Instance 1ed32b7d-a792-49b2-84e7-962f4d537501 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:30:57.540405 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0bcc7653-b7b9-40f3-894d-ecb4bc5ffb77 tempest-AttachVolumeShelveTestJSON-72087033 tempest-AttachVolumeShelveTestJSON-72087033-project] 10.222.0.45 "GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501" status: 404 len: 111 microversion: 2.20 time: 0.032253 Aug 26 18:30:57.540405 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 489/963] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Aug 26 18:30:57 2022] GET /compute/v2.1/servers/1ed32b7d-a792-49b2-84e7-962f4d537501 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 18:30:58.395734 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-822ce44a-75ca-423c-932d-81a6c718280f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:58.396770 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-822ce44a-75ca-423c-932d-81a6c718280f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:58.403999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-822ce44a-75ca-423c-932d-81a6c718280f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:58.404502 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-822ce44a-75ca-423c-932d-81a6c718280f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:58.405429 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-822ce44a-75ca-423c-932d-81a6c718280f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:58.406817 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-822ce44a-75ca-423c-932d-81a6c718280f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:58.407565 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-822ce44a-75ca-423c-932d-81a6c718280f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:58.407996 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-822ce44a-75ca-423c-932d-81a6c718280f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:58.877906 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-822ce44a-75ca-423c-932d-81a6c718280f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:30:58.885787 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-822ce44a-75ca-423c-932d-81a6c718280f tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1682 microversion: 2.1 time: 0.495123 Aug 26 18:30:58.886328 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 475/964] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:30:58 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1682 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:30:59.560751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-03d339ec-1b65-4e13-b9f0-2e7fe895347e req-3aade558-c953-43ab-8429-d539dd3cfc48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028c2a48-f55d-4b36-998a-ce813da73734", "name": "network-vif-deleted", "tag": "ab9be478-b4ed-4055-9dae-990851a1722e"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:30:59.593038 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-03d339ec-1b65-4e13-b9f0-2e7fe895347e req-3aade558-c953-43ab-8429-d539dd3cfc48 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:59.593933 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-03d339ec-1b65-4e13-b9f0-2e7fe895347e req-3aade558-c953-43ab-8429-d539dd3cfc48 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:59.596961 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-03d339ec-1b65-4e13-b9f0-2e7fe895347e req-3aade558-c953-43ab-8429-d539dd3cfc48 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:59.633854 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-03d339ec-1b65-4e13-b9f0-2e7fe895347e req-3aade558-c953-43ab-8429-d539dd3cfc48 service nova] Creating event network-vif-deleted:ab9be478-b4ed-4055-9dae-990851a1722e for instance 028c2a48-f55d-4b36-998a-ce813da73734 on hv-cinder-85199 Aug 26 18:30:59.644005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-03d339ec-1b65-4e13-b9f0-2e7fe895347e req-3aade558-c953-43ab-8429-d539dd3cfc48 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089981 Aug 26 18:30:59.647312 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 490/965] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:30:59.907579 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ced8126e-b10f-410f-b7be-42f828948257 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:30:59.908344 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ced8126e-b10f-410f-b7be-42f828948257 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:30:59.914946 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ced8126e-b10f-410f-b7be-42f828948257 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:59.915743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ced8126e-b10f-410f-b7be-42f828948257 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:59.916381 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ced8126e-b10f-410f-b7be-42f828948257 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:59.917307 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ced8126e-b10f-410f-b7be-42f828948257 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:59.917960 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ced8126e-b10f-410f-b7be-42f828948257 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:59.918570 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ced8126e-b10f-410f-b7be-42f828948257 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:59.957914 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ced8126e-b10f-410f-b7be-42f828948257 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:30:59.958611 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ced8126e-b10f-410f-b7be-42f828948257 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:30:59.959219 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ced8126e-b10f-410f-b7be-42f828948257 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:30:59.959849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-ced8126e-b10f-410f-b7be-42f828948257 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lazy-loading 'fault' on Instance uuid 028c2a48-f55d-4b36-998a-ce813da73734 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:31:00.039098 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ced8126e-b10f-410f-b7be-42f828948257 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1be02f9e7fd4bdabc05ec48e2a35f56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f4fd75428040ab9ff8a0458e4708fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:00.085719 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ced8126e-b10f-410f-b7be-42f828948257 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 200 len: 1332 microversion: 2.1 time: 0.182544 Aug 26 18:31:00.090086 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 476/966] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:30:59 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 1332 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:00.954736 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-343828215", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1376437212", "security_groups": [{"name": "tempest-secgroup-smoke-117333172"}], "networks": [{"uuid": "beddb1fa-27b6-4e84-9dba-bc2d108c0ed1"}], "block_device_mapping_v2": [{"uuid": "e0f3a0ef-2dd6-44e6-a83e-d2f311354a8e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:31:01.108038 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] validate_networks() for [('beddb1fa-27b6-4e84-9dba-bc2d108c0ed1', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:31:01.111628 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-de33961f-7309-4fb6-b5c6-43de207cc098 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:01.112922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-de33961f-7309-4fb6-b5c6-43de207cc098 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:01.129024 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de33961f-7309-4fb6-b5c6-43de207cc098 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:01.129869 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de33961f-7309-4fb6-b5c6-43de207cc098 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:01.130605 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de33961f-7309-4fb6-b5c6-43de207cc098 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:01.131508 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de33961f-7309-4fb6-b5c6-43de207cc098 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:01.132573 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de33961f-7309-4fb6-b5c6-43de207cc098 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:01.133178 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de33961f-7309-4fb6-b5c6-43de207cc098 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:01.149203 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-de33961f-7309-4fb6-b5c6-43de207cc098 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] HTTP exception thrown: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-de33961f-7309-4fb6-b5c6-43de207cc098 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Request method failure captured: Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 HTTP/1.1 Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ_7WV4eHbAqOpnTYkwFP6-jB3HCDjeZbl0R247dr5RR1y2TCZ3q7yJc3wAkX4naY95SpgiF97bav2cRanoMnEaxUU8VKQlnKSHzILsN-blIL91h5HmfvqVCwXlIyEUHdZjNlc9SaFqhXfX303L2e3MPsBKCAHoO-gSYEI6n3TQjqMw Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:31:01.151190 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:31:01.152948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_67f4fd75428040ab9ff8a0458e4708fb", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/67f4fd75428040ab9ff8a0458e4708fb"}]}] Aug 26 18:31:01.152948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:01.152948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:01.152948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:01.152948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:01.152948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:31:01.152948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:31:01.152948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: a1be02f9e7fd4bdabc05ec48e2a35f56 Aug 26 18:31:01.152948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:01.152948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:31:01.152948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. Aug 26 18:31:01.152948 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '028c2a48-f55d-4b36-998a-ce813da73734'} Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:31:01.153910 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. Aug 26 18:31:01.155462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:01.158387 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-de33961f-7309-4fb6-b5c6-43de207cc098 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Returning 404 to user: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:31:01.159413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-de33961f-7309-4fb6-b5c6-43de207cc098 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 404 len: 111 microversion: 2.1 time: 0.052170 Aug 26 18:31:01.165921 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 477/967] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:01 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 18:31:01.174722 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d583bc73-dd80-47d2-8db7-01ba328550a7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '.version_select at 0x7fc7441c43a0>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:01.201700 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-d583bc73-dd80-47d2-8db7-01ba328550a7 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874891470" status: 202 len: 0 microversion: 2.1 time: 0.031151 Aug 26 18:31:01.202529 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 478/968] 10.222.0.45 () {58 vars in 1221 bytes} [Fri Aug 26 18:31:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874891470 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 18:31:02.081211 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:31:02.081900 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:31:02.082018 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:31:02.082437 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:31:02.082832 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:31:02.092496 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:02.093001 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:02.093587 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:02.094274 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:02.094751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:02.095169 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:02.111944 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Getting quotas for project 2023d6404889439f8034ea56372395c1. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:31:02.116267 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Getting quotas for user fd0921be36eb4388a8e3098f5fba3ee7 and project 2023d6404889439f8034ea56372395c1. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:31:02.179300 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:31:02.181707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0f3a0ef-2dd6-44e6-a83e-d2f311354a8e',volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:31:02.314827 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8a9d9372-6b2c-468a-9286-d3f5d516e3d9 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.364254 Aug 26 18:31:02.321343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 491/969] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:31:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 18:31:02.329437 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2681a90b-59cd-423b-aa33-1aa1a92b2d9a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:02.330845 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2681a90b-59cd-423b-aa33-1aa1a92b2d9a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:02.422512 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2681a90b-59cd-423b-aa33-1aa1a92b2d9a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:02.441057 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2681a90b-59cd-423b-aa33-1aa1a92b2d9a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1088 microversion: 2.1 time: 0.117352 Aug 26 18:31:02.443678 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 479/970] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:02 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1088 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:03.462134 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-621b369d-8de4-4a07-afc6-ba398677c8f6 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:03.462746 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-621b369d-8de4-4a07-afc6-ba398677c8f6 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:03.470403 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-621b369d-8de4-4a07-afc6-ba398677c8f6 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:03.471193 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-621b369d-8de4-4a07-afc6-ba398677c8f6 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:03.471568 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-621b369d-8de4-4a07-afc6-ba398677c8f6 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:03.472302 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-621b369d-8de4-4a07-afc6-ba398677c8f6 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:03.472939 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-621b369d-8de4-4a07-afc6-ba398677c8f6 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:03.473368 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-621b369d-8de4-4a07-afc6-ba398677c8f6 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:03.536800 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-621b369d-8de4-4a07-afc6-ba398677c8f6 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:03.544935 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-621b369d-8de4-4a07-afc6-ba398677c8f6 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1194 microversion: 2.1 time: 0.087113 Aug 26 18:31:03.545498 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 492/971] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:03 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:03.936779 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-243376d1-f893-471c-8571-bcd781df96a9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:03.937970 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-243376d1-f893-471c-8571-bcd781df96a9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:03.946892 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-243376d1-f893-471c-8571-bcd781df96a9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:03.947513 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-243376d1-f893-471c-8571-bcd781df96a9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:03.948045 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-243376d1-f893-471c-8571-bcd781df96a9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:03.948953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-243376d1-f893-471c-8571-bcd781df96a9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:03.949509 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-243376d1-f893-471c-8571-bcd781df96a9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:03.950155 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-243376d1-f893-471c-8571-bcd781df96a9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:03.967552 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-243376d1-f893-471c-8571-bcd781df96a9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] HTTP exception thrown: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-243376d1-f893-471c-8571-bcd781df96a9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Request method failure captured: Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: DELETE /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 HTTP/1.1 Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ_7WV4eHbAqOpnTYkwFP6-jB3HCDjeZbl0R247dr5RR1y2TCZ3q7yJc3wAkX4naY95SpgiF97bav2cRanoMnEaxUU8VKQlnKSHzILsN-blIL91h5HmfvqVCwXlIyEUHdZjNlc9SaFqhXfX303L2e3MPsBKCAHoO-gSYEI6n3TQjqMw Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:31:03.969668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:31:03.971298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_67f4fd75428040ab9ff8a0458e4708fb", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/67f4fd75428040ab9ff8a0458e4708fb"}]}] Aug 26 18:31:03.971298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:03.971298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:03.971298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:03.971298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:03.971298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:31:03.971298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:31:03.971298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: a1be02f9e7fd4bdabc05ec48e2a35f56 Aug 26 18:31:03.971298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:03.971298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:31:03.971298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. Aug 26 18:31:03.971298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '028c2a48-f55d-4b36-998a-ce813da73734'} Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:31:03.972231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. Aug 26 18:31:03.973715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:03.975463 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-243376d1-f893-471c-8571-bcd781df96a9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Returning 404 to user: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:31:03.976266 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-243376d1-f893-471c-8571-bcd781df96a9 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "DELETE /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 404 len: 111 microversion: 2.1 time: 0.044273 Aug 26 18:31:03.985037 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 480/972] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:31:03 2022] DELETE /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:31:03.991244 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-24987aff-bada-4717-bd05-8153898baf74 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:03.992410 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-24987aff-bada-4717-bd05-8153898baf74 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 028c2a48-f55d-4b36-998a-ce813da73734] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:04.000333 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24987aff-bada-4717-bd05-8153898baf74 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:04.001203 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24987aff-bada-4717-bd05-8153898baf74 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:04.002055 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24987aff-bada-4717-bd05-8153898baf74 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:04.003135 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24987aff-bada-4717-bd05-8153898baf74 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:04.003615 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24987aff-bada-4717-bd05-8153898baf74 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:04.004223 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24987aff-bada-4717-bd05-8153898baf74 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:04.023647 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-24987aff-bada-4717-bd05-8153898baf74 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] HTTP exception thrown: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-24987aff-bada-4717-bd05-8153898baf74 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Request method failure captured: Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 HTTP/1.1 Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ_7WV4eHbAqOpnTYkwFP6-jB3HCDjeZbl0R247dr5RR1y2TCZ3q7yJc3wAkX4naY95SpgiF97bav2cRanoMnEaxUU8VKQlnKSHzILsN-blIL91h5HmfvqVCwXlIyEUHdZjNlc9SaFqhXfX303L2e3MPsBKCAHoO-gSYEI6n3TQjqMw Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:31:04.028650 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:31:04.030245 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_67f4fd75428040ab9ff8a0458e4708fb", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/67f4fd75428040ab9ff8a0458e4708fb"}]}] Aug 26 18:31:04.030245 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:04.030245 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:04.030245 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:04.030245 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:04.030245 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:31:04.030245 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:31:04.030245 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: a1be02f9e7fd4bdabc05ec48e2a35f56 Aug 26 18:31:04.030245 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:04.030245 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:31:04.030245 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. Aug 26 18:31:04.030245 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': '028c2a48-f55d-4b36-998a-ce813da73734'} Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:31:04.031017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. Aug 26 18:31:04.032709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.033922 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-24987aff-bada-4717-bd05-8153898baf74 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Returning 404 to user: Instance 028c2a48-f55d-4b36-998a-ce813da73734 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:31:04.033922 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-24987aff-bada-4717-bd05-8153898baf74 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734" status: 404 len: 111 microversion: 2.1 time: 0.044439 Aug 26 18:31:04.033922 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 493/973] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:03 2022] GET /compute/v2.1/servers/028c2a48-f55d-4b36-998a-ce813da73734 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:31:04.236513 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-90d1b7ab-64fb-4d72-8271-bdc19ea1dbc7 tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Action: 'create', calling method: .version_select at 0x7fc744075af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1335724133", "metadata": {"Type": "work"}}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-90d1b7ab-64fb-4d72-8271-bdc19ea1dbc7 tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Request method failure captured: Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 122 Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCRFnNYG_HI8KQHWj7k7vVPZmZQVBGBXPEjPvgwC5_1gqmt3UJEASeif0_SL8Zl2QMXAuE6EWzZqxHcso8CZEBIzsjxwT-tCS-442XNakW-Ee-O8QaspnAa8rodaTwwIYrUfaexZeCIHU8SwJB2llKG0iMJi9U1aw1ZGizkLGXs8qoKU Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 348cbae2c5274a509185611c7570e498 Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:31:04.262720 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:31:04.264863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_348cbae2c5274a509185611c7570e498", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/348cbae2c5274a509185611c7570e498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/348cbae2c5274a509185611c7570e498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/348cbae2c5274a509185611c7570e498"}]}] Aug 26 18:31:04.264863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.264863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 348cbae2c5274a509185611c7570e498 Aug 26 18:31:04.264863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.264863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-VolumesNegativeTest-1973694202-project Aug 26 18:31:04.264863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:31:04.264863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:31:04.264863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: 80cf1659e1264cd6872aaaadb388c242 Aug 26 18:31:04.264863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-VolumesNegativeTest-1973694202-project Aug 26 18:31:04.264863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Aug 26 18:31:04.264863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1335724133", "metadata": {"Type": "work"}}} Aug 26 18:31:04.264863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: Aug 26 18:31:04.264863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1335724133', 'metadata': {'Type': 'work'}}}} Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise error Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi '#$%' Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:31:04.266202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 18:31:04.267849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 18:31:04.269317 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 18:31:04.269317 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.271476 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-90d1b7ab-64fb-4d72-8271-bdc19ea1dbc7 tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:31:04.273055 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-90d1b7ab-64fb-4d72-8271-bdc19ea1dbc7 tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.179614 Aug 26 18:31:04.274750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 481/974] 10.222.0.45 () {60 vars in 1156 bytes} [Fri Aug 26 18:31:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 18:31:04.285064 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-06208fdb-893d-4a48-8817-e59fbc730e54 tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Action: 'create', calling method: .version_select at 0x7fc74425aaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-303606033", "metadata": {"Type": "work"}}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-06208fdb-893d-4a48-8817-e59fbc730e54 tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Request method failure captured: Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 119 Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCRFnNYG_HI8KQHWj7k7vVPZmZQVBGBXPEjPvgwC5_1gqmt3UJEASeif0_SL8Zl2QMXAuE6EWzZqxHcso8CZEBIzsjxwT-tCS-442XNakW-Ee-O8QaspnAa8rodaTwwIYrUfaexZeCIHU8SwJB2llKG0iMJi9U1aw1ZGizkLGXs8qoKU Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 348cbae2c5274a509185611c7570e498 Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:31:04.291284 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:31:04.293560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_348cbae2c5274a509185611c7570e498", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/348cbae2c5274a509185611c7570e498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/348cbae2c5274a509185611c7570e498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/348cbae2c5274a509185611c7570e498"}]}] Aug 26 18:31:04.293560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.293560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 348cbae2c5274a509185611c7570e498 Aug 26 18:31:04.293560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.293560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesNegativeTest-1973694202-project Aug 26 18:31:04.293560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:31:04.293560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:31:04.293560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: 80cf1659e1264cd6872aaaadb388c242 Aug 26 18:31:04.293560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesNegativeTest-1973694202-project Aug 26 18:31:04.293560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Aug 26 18:31:04.293560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-303606033", "metadata": {"Type": "work"}}} Aug 26 18:31:04.293560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: Aug 26 18:31:04.293560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-303606033', 'metadata': {'Type': 'work'}}}} Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise error Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi '0' Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:31:04.295301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 18:31:04.297911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 18:31:04.299893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 18:31:04.299893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.299893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-06208fdb-893d-4a48-8817-e59fbc730e54 tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:31:04.299893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-06208fdb-893d-4a48-8817-e59fbc730e54 tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013036 Aug 26 18:31:04.299893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 494/975] 10.222.0.45 () {60 vars in 1156 bytes} [Fri Aug 26 18:31:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 18:31:04.306692 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7026d233-6b09-4a11-9443-7992c4d71e1c tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Action: 'create', calling method: .version_select at 0x7fc73ffe0ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1438535507", "metadata": {"Type": "work"}}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7026d233-6b09-4a11-9443-7992c4d71e1c tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Request method failure captured: Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 119 Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCRFnNYG_HI8KQHWj7k7vVPZmZQVBGBXPEjPvgwC5_1gqmt3UJEASeif0_SL8Zl2QMXAuE6EWzZqxHcso8CZEBIzsjxwT-tCS-442XNakW-Ee-O8QaspnAa8rodaTwwIYrUfaexZeCIHU8SwJB2llKG0iMJi9U1aw1ZGizkLGXs8qoKU Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 348cbae2c5274a509185611c7570e498 Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:31:04.310861 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:31:04.312398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_348cbae2c5274a509185611c7570e498", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/348cbae2c5274a509185611c7570e498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/348cbae2c5274a509185611c7570e498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/348cbae2c5274a509185611c7570e498"}]}] Aug 26 18:31:04.312398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.312398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 348cbae2c5274a509185611c7570e498 Aug 26 18:31:04.312398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.312398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-VolumesNegativeTest-1973694202-project Aug 26 18:31:04.312398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:31:04.312398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:31:04.312398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: 80cf1659e1264cd6872aaaadb388c242 Aug 26 18:31:04.312398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-VolumesNegativeTest-1973694202-project Aug 26 18:31:04.312398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Aug 26 18:31:04.312398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1438535507", "metadata": {"Type": "work"}}} Aug 26 18:31:04.312398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: Aug 26 18:31:04.312398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1438535507', 'metadata': {'Type': 'work'}}}} Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise error Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi '' Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:31:04.313388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 18:31:04.314858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 18:31:04.316022 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 18:31:04.316022 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.316022 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7026d233-6b09-4a11-9443-7992c4d71e1c tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:31:04.316022 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-7026d233-6b09-4a11-9443-7992c4d71e1c tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013201 Aug 26 18:31:04.316022 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 482/976] 10.222.0.45 () {60 vars in 1156 bytes} [Fri Aug 26 18:31:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 18:31:04.323642 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d1bd796-30ab-445a-b018-0401153b9d9a tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Calling method '.version_select at 0x7fc74410edc0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:04.363840 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-7d1bd796-30ab-445a-b018-0401153b9d9a tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] HTTP exception thrown: Volume tempest-invalid-928567905 could not be found. Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d1bd796-30ab-445a-b018-0401153b9d9a tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Request method failure captured: Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-928567905 HTTP/1.1 Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCRFnNYG_HI8KQHWj7k7vVPZmZQVBGBXPEjPvgwC5_1gqmt3UJEASeif0_SL8Zl2QMXAuE6EWzZqxHcso8CZEBIzsjxwT-tCS-442XNakW-Ee-O8QaspnAa8rodaTwwIYrUfaexZeCIHU8SwJB2llKG0iMJi9U1aw1ZGizkLGXs8qoKU Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 348cbae2c5274a509185611c7570e498 Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:31:04.366188 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:31:04.367613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_348cbae2c5274a509185611c7570e498", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/348cbae2c5274a509185611c7570e498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/348cbae2c5274a509185611c7570e498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/348cbae2c5274a509185611c7570e498"}]}] Aug 26 18:31:04.367613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.367613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 348cbae2c5274a509185611c7570e498 Aug 26 18:31:04.367613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.367613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesNegativeTest-1973694202-project Aug 26 18:31:04.367613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:31:04.367613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:31:04.367613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: 80cf1659e1264cd6872aaaadb388c242 Aug 26 18:31:04.367613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesNegativeTest-1973694202-project Aug 26 18:31:04.367613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: Aug 26 18:31:04.367613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Volume tempest-invalid-928567905 could not be found. Aug 26 18:31:04.367613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': 'tempest-invalid-928567905'} Aug 26 18:31:04.367613 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-928567905 could not be found. (HTTP 404) (Request-ID: req-d0b6ea94-f48a-4272-92c8-11ce6a226333) Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.368485 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 18:31:04.374077 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-928567905 could not be found. Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:31:04.375537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-928567905 could not be found. Aug 26 18:31:04.377060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.377060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.377060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.377060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.377060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:04.377060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:04.377060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:31:04.377060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:31:04.377060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-928567905 could not be found. Aug 26 18:31:04.377060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.377060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d1bd796-30ab-445a-b018-0401153b9d9a tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Returning 404 to user: Volume tempest-invalid-928567905 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:31:04.377060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7d1bd796-30ab-445a-b018-0401153b9d9a tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-928567905" status: 404 len: 98 microversion: 2.1 time: 0.049454 Aug 26 18:31:04.377060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 495/977] 10.222.0.45 () {58 vars in 1215 bytes} [Fri Aug 26 18:31:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-928567905 => generated 98 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 26 18:31:04.379135 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ecd60d97-92f6-452e-8b29-316995ebe808 tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003827 Aug 26 18:31:04.379638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 483/978] 10.222.0.45 () {58 vars in 1140 bytes} [Fri Aug 26 18:31:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 26 18:31:04.389190 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a41721bf-1198-410f-9a5a-2a5a5a633d2c tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004430 Aug 26 18:31:04.389719 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 496/979] 10.222.0.45 () {58 vars in 1137 bytes} [Fri Aug 26 18:31:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 26 18:31:04.398944 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e5a309a1-b144-4255-9df2-ce3713490314 tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Calling method '.version_select at 0x7fc744075f70>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:04.430805 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-e5a309a1-b144-4255-9df2-ce3713490314 tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] HTTP exception thrown: Volume 2da47ac3-6547-4a0a-a668-c7d7d670f611 could not be found. Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e5a309a1-b144-4255-9df2-ce3713490314 tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Request method failure captured: Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: DELETE /compute/v2.1/os-volumes/2da47ac3-6547-4a0a-a668-c7d7d670f611 HTTP/1.1 Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCRFnNYG_HI8KQHWj7k7vVPZmZQVBGBXPEjPvgwC5_1gqmt3UJEASeif0_SL8Zl2QMXAuE6EWzZqxHcso8CZEBIzsjxwT-tCS-442XNakW-Ee-O8QaspnAa8rodaTwwIYrUfaexZeCIHU8SwJB2llKG0iMJi9U1aw1ZGizkLGXs8qoKU Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 348cbae2c5274a509185611c7570e498 Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:31:04.432849 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:31:04.434252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_348cbae2c5274a509185611c7570e498", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/348cbae2c5274a509185611c7570e498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/348cbae2c5274a509185611c7570e498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/348cbae2c5274a509185611c7570e498"}]}] Aug 26 18:31:04.434252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.434252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 348cbae2c5274a509185611c7570e498 Aug 26 18:31:04.434252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.434252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-VolumesNegativeTest-1973694202-project Aug 26 18:31:04.434252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:31:04.434252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:31:04.434252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: 80cf1659e1264cd6872aaaadb388c242 Aug 26 18:31:04.434252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-VolumesNegativeTest-1973694202-project Aug 26 18:31:04.434252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: Aug 26 18:31:04.434252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Volume 2da47ac3-6547-4a0a-a668-c7d7d670f611 could not be found. Aug 26 18:31:04.434252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '2da47ac3-6547-4a0a-a668-c7d7d670f611'} Aug 26 18:31:04.434252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2da47ac3-6547-4a0a-a668-c7d7d670f611 could not be found. (HTTP 404) (Request-ID: req-ac7f9962-b3b2-4bfa-8b4d-1c211eb4cc59) Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.435064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 18:31:04.436263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2da47ac3-6547-4a0a-a668-c7d7d670f611 could not be found. Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 18:31:04.437714 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:31:04.439598 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2da47ac3-6547-4a0a-a668-c7d7d670f611 could not be found. Aug 26 18:31:04.439598 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.439598 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.439598 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.439598 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.439598 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:04.439598 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:04.439598 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:31:04.439598 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:31:04.439598 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2da47ac3-6547-4a0a-a668-c7d7d670f611 could not be found. Aug 26 18:31:04.439598 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.439598 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e5a309a1-b144-4255-9df2-ce3713490314 tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Returning 404 to user: Volume 2da47ac3-6547-4a0a-a668-c7d7d670f611 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:31:04.439598 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e5a309a1-b144-4255-9df2-ce3713490314 tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/2da47ac3-6547-4a0a-a668-c7d7d670f611" status: 404 len: 109 microversion: 2.1 time: 0.039346 Aug 26 18:31:04.445282 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 484/980] 10.222.0.45 () {58 vars in 1248 bytes} [Fri Aug 26 18:31:04 2022] DELETE /compute/v2.1/os-volumes/2da47ac3-6547-4a0a-a668-c7d7d670f611 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 18:31:04.445626 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6067c9bf-88ec-4675-886a-98bc6034d24a tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Calling method '.version_select at 0x7fc74425a9d0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:04.473846 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-6067c9bf-88ec-4675-886a-98bc6034d24a tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] HTTP exception thrown: Volume 5b7b27fe-0904-4966-b783-b4d5b887bfea could not be found. Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6067c9bf-88ec-4675-886a-98bc6034d24a tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Request method failure captured: Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/os-volumes/5b7b27fe-0904-4966-b783-b4d5b887bfea HTTP/1.1 Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCRFnNYG_HI8KQHWj7k7vVPZmZQVBGBXPEjPvgwC5_1gqmt3UJEASeif0_SL8Zl2QMXAuE6EWzZqxHcso8CZEBIzsjxwT-tCS-442XNakW-Ee-O8QaspnAa8rodaTwwIYrUfaexZeCIHU8SwJB2llKG0iMJi9U1aw1ZGizkLGXs8qoKU Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 348cbae2c5274a509185611c7570e498 Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:31:04.476707 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:31:04.478100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_348cbae2c5274a509185611c7570e498", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/348cbae2c5274a509185611c7570e498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/348cbae2c5274a509185611c7570e498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/348cbae2c5274a509185611c7570e498"}]}] Aug 26 18:31:04.478100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.478100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 348cbae2c5274a509185611c7570e498 Aug 26 18:31:04.478100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesNegativeTest-1973694202 Aug 26 18:31:04.478100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesNegativeTest-1973694202-project Aug 26 18:31:04.478100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:31:04.478100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:31:04.478100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: 80cf1659e1264cd6872aaaadb388c242 Aug 26 18:31:04.478100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesNegativeTest-1973694202-project Aug 26 18:31:04.478100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: Aug 26 18:31:04.478100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Volume 5b7b27fe-0904-4966-b783-b4d5b887bfea could not be found. Aug 26 18:31:04.478100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': '5b7b27fe-0904-4966-b783-b4d5b887bfea'} Aug 26 18:31:04.478100 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b7b27fe-0904-4966-b783-b4d5b887bfea could not be found. (HTTP 404) (Request-ID: req-78bfb364-4bea-478b-8da2-0159a8c3fbd6) Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.479105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 18:31:04.481391 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b7b27fe-0904-4966-b783-b4d5b887bfea could not be found. Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 18:31:04.484784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:31:04.488218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b7b27fe-0904-4966-b783-b4d5b887bfea could not be found. Aug 26 18:31:04.488218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.488218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:04.488218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.488218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:04.488218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:04.488218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:04.488218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:31:04.488218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:31:04.488218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b7b27fe-0904-4966-b783-b4d5b887bfea could not be found. Aug 26 18:31:04.488218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:04.488218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6067c9bf-88ec-4675-886a-98bc6034d24a tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] Returning 404 to user: Volume 5b7b27fe-0904-4966-b783-b4d5b887bfea could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:31:04.488218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6067c9bf-88ec-4675-886a-98bc6034d24a tempest-VolumesNegativeTest-1973694202 tempest-VolumesNegativeTest-1973694202-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/5b7b27fe-0904-4966-b783-b4d5b887bfea" status: 404 len: 109 microversion: 2.1 time: 0.037066 Aug 26 18:31:04.488218 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 497/981] 10.222.0.45 () {58 vars in 1245 bytes} [Fri Aug 26 18:31:04 2022] GET /compute/v2.1/os-volumes/5b7b27fe-0904-4966-b783-b4d5b887bfea => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:31:04.565766 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-adb2d1de-cb32-4564-a97b-5e80b3209261 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:04.566438 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-adb2d1de-cb32-4564-a97b-5e80b3209261 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:04.574078 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-adb2d1de-cb32-4564-a97b-5e80b3209261 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:04.574647 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-adb2d1de-cb32-4564-a97b-5e80b3209261 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:04.575142 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-adb2d1de-cb32-4564-a97b-5e80b3209261 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:04.575966 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-adb2d1de-cb32-4564-a97b-5e80b3209261 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:04.576407 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-adb2d1de-cb32-4564-a97b-5e80b3209261 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:04.576904 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-adb2d1de-cb32-4564-a97b-5e80b3209261 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:04.771481 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-adb2d1de-cb32-4564-a97b-5e80b3209261 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:04.777373 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-adb2d1de-cb32-4564-a97b-5e80b3209261 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1259 microversion: 2.1 time: 0.215514 Aug 26 18:31:04.790229 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 485/982] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:04 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:05.064401 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-7c88f440-8adf-482b-b986-5409e52aebcc req-4bfa391c-6e8b-4ced-9c31-e235e0d56f6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a74e4cb-8108-4101-8dbe-c063481f2967", "tag": "9b7f8fc1-6d04-4211-ab6a-e06a963d8464"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:31:05.080215 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-7c88f440-8adf-482b-b986-5409e52aebcc req-4bfa391c-6e8b-4ced-9c31-e235e0d56f6e service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:05.081202 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-7c88f440-8adf-482b-b986-5409e52aebcc req-4bfa391c-6e8b-4ced-9c31-e235e0d56f6e service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:05.081929 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-7c88f440-8adf-482b-b986-5409e52aebcc req-4bfa391c-6e8b-4ced-9c31-e235e0d56f6e service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:05.095037 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-7c88f440-8adf-482b-b986-5409e52aebcc req-4bfa391c-6e8b-4ced-9c31-e235e0d56f6e service nova] Creating event network-changed:9b7f8fc1-6d04-4211-ab6a-e06a963d8464 for instance 8a74e4cb-8108-4101-8dbe-c063481f2967 on hv-cinder-85199 Aug 26 18:31:05.103393 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-7c88f440-8adf-482b-b986-5409e52aebcc req-4bfa391c-6e8b-4ced-9c31-e235e0d56f6e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043015 Aug 26 18:31:05.104540 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 498/983] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:31:05.210417 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9f6cea19-d4d5-47e9-a077-11a07f5c4d25 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:05.210957 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9f6cea19-d4d5-47e9-a077-11a07f5c4d25 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:05.217150 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9f6cea19-d4d5-47e9-a077-11a07f5c4d25 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:05.217634 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9f6cea19-d4d5-47e9-a077-11a07f5c4d25 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:05.218058 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9f6cea19-d4d5-47e9-a077-11a07f5c4d25 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:05.218746 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9f6cea19-d4d5-47e9-a077-11a07f5c4d25 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:05.219202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9f6cea19-d4d5-47e9-a077-11a07f5c4d25 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:05.219600 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9f6cea19-d4d5-47e9-a077-11a07f5c4d25 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:05.233638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-9f6cea19-d4d5-47e9-a077-11a07f5c4d25 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] HTTP exception thrown: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9f6cea19-d4d5-47e9-a077-11a07f5c4d25 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Request method failure captured: Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: DELETE /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 HTTP/1.1 Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ_7WV4eHbAqOpnTYkwFP6-jB3HCDjeZbl0R247dr5RR1y2TCZ3q7yJc3wAkX4naY95SpgiF97bav2cRanoMnEaxUU8VKQlnKSHzILsN-blIL91h5HmfvqVCwXlIyEUHdZjNlc9SaFqhXfX303L2e3MPsBKCAHoO-gSYEI6n3TQjqMw Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:31:05.235279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:31:05.237088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_67f4fd75428040ab9ff8a0458e4708fb", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/67f4fd75428040ab9ff8a0458e4708fb"}]}] Aug 26 18:31:05.237088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:05.237088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:05.237088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:05.237088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:05.237088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:31:05.237088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:31:05.237088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: a1be02f9e7fd4bdabc05ec48e2a35f56 Aug 26 18:31:05.237088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:05.237088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:31:05.237088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. Aug 26 18:31:05.237088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '4cbde000-0844-4305-9309-31a6e53167a7'} Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:31:05.237999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. Aug 26 18:31:05.239411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.241112 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9f6cea19-d4d5-47e9-a077-11a07f5c4d25 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Returning 404 to user: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:31:05.241112 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9f6cea19-d4d5-47e9-a077-11a07f5c4d25 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 404 len: 111 microversion: 2.1 time: 0.030193 Aug 26 18:31:05.241112 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 486/984] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:31:05 2022] DELETE /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:31:05.249801 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6cdf9797-6a6a-4b64-9a09-5dbdcb6fddaa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:05.250600 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6cdf9797-6a6a-4b64-9a09-5dbdcb6fddaa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: 4cbde000-0844-4305-9309-31a6e53167a7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:05.256962 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cdf9797-6a6a-4b64-9a09-5dbdcb6fddaa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:05.258179 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cdf9797-6a6a-4b64-9a09-5dbdcb6fddaa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:05.258806 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cdf9797-6a6a-4b64-9a09-5dbdcb6fddaa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:05.259536 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cdf9797-6a6a-4b64-9a09-5dbdcb6fddaa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:05.259960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cdf9797-6a6a-4b64-9a09-5dbdcb6fddaa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:05.260450 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6cdf9797-6a6a-4b64-9a09-5dbdcb6fddaa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:05.264853 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:05.276003 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-6cdf9797-6a6a-4b64-9a09-5dbdcb6fddaa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] HTTP exception thrown: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6cdf9797-6a6a-4b64-9a09-5dbdcb6fddaa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Request method failure captured: Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 HTTP/1.1 Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ_7WV4eHbAqOpnTYkwFP6-jB3HCDjeZbl0R247dr5RR1y2TCZ3q7yJc3wAkX4naY95SpgiF97bav2cRanoMnEaxUU8VKQlnKSHzILsN-blIL91h5HmfvqVCwXlIyEUHdZjNlc9SaFqhXfX303L2e3MPsBKCAHoO-gSYEI6n3TQjqMw Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:31:05.277956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:31:05.279343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_67f4fd75428040ab9ff8a0458e4708fb", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/67f4fd75428040ab9ff8a0458e4708fb"}]}] Aug 26 18:31:05.279343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:05.279343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:05.279343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:05.279343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:05.279343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:31:05.279343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:31:05.279343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: a1be02f9e7fd4bdabc05ec48e2a35f56 Aug 26 18:31:05.279343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:05.279343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:31:05.279343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. Aug 26 18:31:05.279343 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': '4cbde000-0844-4305-9309-31a6e53167a7'} Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:31:05.280129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. Aug 26 18:31:05.281476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.282924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6cdf9797-6a6a-4b64-9a09-5dbdcb6fddaa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Returning 404 to user: Instance 4cbde000-0844-4305-9309-31a6e53167a7 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:31:05.282924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6cdf9797-6a6a-4b64-9a09-5dbdcb6fddaa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7" status: 404 len: 111 microversion: 2.1 time: 0.033965 Aug 26 18:31:05.282924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 499/985] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:05 2022] GET /compute/v2.1/servers/4cbde000-0844-4305-9309-31a6e53167a7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:31:05.288626 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-58e846ba-57a3-4508-9770-3742f16309aa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:05.289200 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-58e846ba-57a3-4508-9770-3742f16309aa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:05.295284 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-58e846ba-57a3-4508-9770-3742f16309aa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:05.295780 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-58e846ba-57a3-4508-9770-3742f16309aa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:05.296212 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-58e846ba-57a3-4508-9770-3742f16309aa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:05.297213 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-58e846ba-57a3-4508-9770-3742f16309aa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:05.297669 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-58e846ba-57a3-4508-9770-3742f16309aa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:05.298088 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-58e846ba-57a3-4508-9770-3742f16309aa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:05.315423 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-58e846ba-57a3-4508-9770-3742f16309aa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] HTTP exception thrown: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-58e846ba-57a3-4508-9770-3742f16309aa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Request method failure captured: Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: DELETE /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 HTTP/1.1 Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ_7WV4eHbAqOpnTYkwFP6-jB3HCDjeZbl0R247dr5RR1y2TCZ3q7yJc3wAkX4naY95SpgiF97bav2cRanoMnEaxUU8VKQlnKSHzILsN-blIL91h5HmfvqVCwXlIyEUHdZjNlc9SaFqhXfX303L2e3MPsBKCAHoO-gSYEI6n3TQjqMw Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:31:05.317096 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:31:05.318414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_67f4fd75428040ab9ff8a0458e4708fb", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/67f4fd75428040ab9ff8a0458e4708fb"}]}] Aug 26 18:31:05.318414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:05.318414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:05.318414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:05.318414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:05.318414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:31:05.318414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:31:05.318414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: a1be02f9e7fd4bdabc05ec48e2a35f56 Aug 26 18:31:05.318414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:05.318414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:31:05.318414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. Aug 26 18:31:05.318414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': 'b1da52f0-5bd3-4c2e-b4e5-87627616f667'} Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:31:05.319156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. Aug 26 18:31:05.320920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.322538 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-58e846ba-57a3-4508-9770-3742f16309aa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Returning 404 to user: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:31:05.322538 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-58e846ba-57a3-4508-9770-3742f16309aa tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 404 len: 111 microversion: 2.1 time: 0.033769 Aug 26 18:31:05.322871 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 487/986] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:31:05 2022] DELETE /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 18:31:05.328402 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7c80396f-828b-4213-9801-faf66521707d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:05.329268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7c80396f-828b-4213-9801-faf66521707d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: b1da52f0-5bd3-4c2e-b4e5-87627616f667] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:05.336098 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c80396f-828b-4213-9801-faf66521707d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:05.336674 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c80396f-828b-4213-9801-faf66521707d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:05.337271 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c80396f-828b-4213-9801-faf66521707d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:05.338082 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c80396f-828b-4213-9801-faf66521707d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:05.338603 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c80396f-828b-4213-9801-faf66521707d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:05.339277 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c80396f-828b-4213-9801-faf66521707d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:05.355293 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-7c80396f-828b-4213-9801-faf66521707d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] HTTP exception thrown: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7c80396f-828b-4213-9801-faf66521707d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Request method failure captured: Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 HTTP/1.1 Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ_7WV4eHbAqOpnTYkwFP6-jB3HCDjeZbl0R247dr5RR1y2TCZ3q7yJc3wAkX4naY95SpgiF97bav2cRanoMnEaxUU8VKQlnKSHzILsN-blIL91h5HmfvqVCwXlIyEUHdZjNlc9SaFqhXfX303L2e3MPsBKCAHoO-gSYEI6n3TQjqMw Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:31:05.357492 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:31:05.359065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_67f4fd75428040ab9ff8a0458e4708fb", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/67f4fd75428040ab9ff8a0458e4708fb"}]}] Aug 26 18:31:05.359065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:05.359065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:05.359065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:05.359065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:05.359065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:31:05.359065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:31:05.359065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: a1be02f9e7fd4bdabc05ec48e2a35f56 Aug 26 18:31:05.359065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:05.359065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:31:05.359065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. Aug 26 18:31:05.359065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': 'b1da52f0-5bd3-4c2e-b4e5-87627616f667'} Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:31:05.359907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. Aug 26 18:31:05.365960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:05.369236 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7c80396f-828b-4213-9801-faf66521707d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Returning 404 to user: Instance b1da52f0-5bd3-4c2e-b4e5-87627616f667 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:31:05.369236 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7c80396f-828b-4213-9801-faf66521707d tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667" status: 404 len: 111 microversion: 2.1 time: 0.034909 Aug 26 18:31:05.369236 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 500/987] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:05 2022] GET /compute/v2.1/servers/b1da52f0-5bd3-4c2e-b4e5-87627616f667 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:31:05.803477 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8ff38d40-8be6-4894-87f2-4fe833c8fe15 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:05.804272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8ff38d40-8be6-4894-87f2-4fe833c8fe15 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:05.812161 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8ff38d40-8be6-4894-87f2-4fe833c8fe15 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:05.812785 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8ff38d40-8be6-4894-87f2-4fe833c8fe15 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:05.813289 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8ff38d40-8be6-4894-87f2-4fe833c8fe15 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:05.814057 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8ff38d40-8be6-4894-87f2-4fe833c8fe15 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:05.815022 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8ff38d40-8be6-4894-87f2-4fe833c8fe15 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:05.815511 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8ff38d40-8be6-4894-87f2-4fe833c8fe15 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:06.054093 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8ff38d40-8be6-4894-87f2-4fe833c8fe15 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:06.064280 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8ff38d40-8be6-4894-87f2-4fe833c8fe15 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1259 microversion: 2.1 time: 0.265005 Aug 26 18:31:06.077436 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 488/988] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:05 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1259 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:06.523786 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7c5d2da3-42dd-493c-b369-09decb9814f0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:06.524279 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7c5d2da3-42dd-493c-b369-09decb9814f0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:06.531524 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5d2da3-42dd-493c-b369-09decb9814f0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:06.532253 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5d2da3-42dd-493c-b369-09decb9814f0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:06.532684 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5d2da3-42dd-493c-b369-09decb9814f0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:06.533418 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5d2da3-42dd-493c-b369-09decb9814f0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:06.533870 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5d2da3-42dd-493c-b369-09decb9814f0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:06.534308 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5d2da3-42dd-493c-b369-09decb9814f0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:06.547841 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-7c5d2da3-42dd-493c-b369-09decb9814f0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] HTTP exception thrown: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7c5d2da3-42dd-493c-b369-09decb9814f0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Request method failure captured: Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b HTTP/1.1 Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCQ_7WV4eHbAqOpnTYkwFP6-jB3HCDjeZbl0R247dr5RR1y2TCZ3q7yJc3wAkX4naY95SpgiF97bav2cRanoMnEaxUU8VKQlnKSHzILsN-blIL91h5HmfvqVCwXlIyEUHdZjNlc9SaFqhXfX303L2e3MPsBKCAHoO-gSYEI6n3TQjqMw Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:31:06.549810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:31:06.551390 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_67f4fd75428040ab9ff8a0458e4708fb", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/67f4fd75428040ab9ff8a0458e4708fb"}]}] Aug 26 18:31:06.551390 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:06.551390 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:06.551390 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:06.551390 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:06.551390 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:31:06.551390 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:31:06.551390 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: a1be02f9e7fd4bdabc05ec48e2a35f56 Aug 26 18:31:06.551390 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:06.551390 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:31:06.551390 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. Aug 26 18:31:06.551390 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': 'eb0359a4-7ac3-470c-8fe7-31ed2faab28b'} Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:31:06.552296 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. Aug 26 18:31:06.553848 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:31:06.555377 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7c5d2da3-42dd-493c-b369-09decb9814f0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Returning 404 to user: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:31:06.555377 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7c5d2da3-42dd-493c-b369-09decb9814f0 tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "DELETE /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 404 len: 111 microversion: 2.1 time: 0.030936 Aug 26 18:31:06.555377 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 501/989] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:31:06 2022] DELETE /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:31:06.560312 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8a569b43-b532-40b0-a154-d321fb0a8a9c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:06.560954 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8a569b43-b532-40b0-a154-d321fb0a8a9c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] [instance: eb0359a4-7ac3-470c-8fe7-31ed2faab28b] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:06.566900 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8a569b43-b532-40b0-a154-d321fb0a8a9c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:06.567371 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8a569b43-b532-40b0-a154-d321fb0a8a9c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:06.567801 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8a569b43-b532-40b0-a154-d321fb0a8a9c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:06.568498 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8a569b43-b532-40b0-a154-d321fb0a8a9c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:06.569018 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8a569b43-b532-40b0-a154-d321fb0a8a9c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:06.569406 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8a569b43-b532-40b0-a154-d321fb0a8a9c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:06.583036 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-8a569b43-b532-40b0-a154-d321fb0a8a9c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] HTTP exception thrown: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8a569b43-b532-40b0-a154-d321fb0a8a9c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Request method failure captured: Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b HTTP/1.1 Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCQ_7WV4eHbAqOpnTYkwFP6-jB3HCDjeZbl0R247dr5RR1y2TCZ3q7yJc3wAkX4naY95SpgiF97bav2cRanoMnEaxUU8VKQlnKSHzILsN-blIL91h5HmfvqVCwXlIyEUHdZjNlc9SaFqhXfX303L2e3MPsBKCAHoO-gSYEI6n3TQjqMw Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:31:06.584569 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:31:06.586205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_67f4fd75428040ab9ff8a0458e4708fb", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/67f4fd75428040ab9ff8a0458e4708fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/67f4fd75428040ab9ff8a0458e4708fb"}]}] Aug 26 18:31:06.586205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:06.586205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 67f4fd75428040ab9ff8a0458e4708fb Aug 26 18:31:06.586205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-296969336 Aug 26 18:31:06.586205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:06.586205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:31:06.586205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:31:06.586205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: a1be02f9e7fd4bdabc05ec48e2a35f56 Aug 26 18:31:06.586205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-AttachVolumeNegativeTest-296969336-project Aug 26 18:31:06.586205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:31:06.586205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. Aug 26 18:31:06.586205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': 'eb0359a4-7ac3-470c-8fe7-31ed2faab28b'} Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:31:06.587335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. Aug 26 18:31:06.588545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:31:06.589846 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8a569b43-b532-40b0-a154-d321fb0a8a9c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] Returning 404 to user: Instance eb0359a4-7ac3-470c-8fe7-31ed2faab28b could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:31:06.589846 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8a569b43-b532-40b0-a154-d321fb0a8a9c tempest-AttachVolumeNegativeTest-296969336 tempest-AttachVolumeNegativeTest-296969336-project] 10.222.0.45 "GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b" status: 404 len: 111 microversion: 2.1 time: 0.030314 Aug 26 18:31:06.589846 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 489/990] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:06 2022] GET /compute/v2.1/servers/eb0359a4-7ac3-470c-8fe7-31ed2faab28b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:31:07.086054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8dd95133-8a71-44f8-b768-3c86d8613159 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:07.087278 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8dd95133-8a71-44f8-b768-3c86d8613159 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:07.094563 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dd95133-8a71-44f8-b768-3c86d8613159 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:07.102513 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dd95133-8a71-44f8-b768-3c86d8613159 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:07.103051 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dd95133-8a71-44f8-b768-3c86d8613159 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:07.103865 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dd95133-8a71-44f8-b768-3c86d8613159 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:07.104582 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dd95133-8a71-44f8-b768-3c86d8613159 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:07.105104 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dd95133-8a71-44f8-b768-3c86d8613159 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:07.343692 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8dd95133-8a71-44f8-b768-3c86d8613159 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:07.352974 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8dd95133-8a71-44f8-b768-3c86d8613159 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1259 microversion: 2.1 time: 0.270855 Aug 26 18:31:07.353723 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 502/991] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:07 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1259 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:08.374401 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-a5d7d2f7-c940-40ae-aa12-68371cbf281c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:08.375014 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-a5d7d2f7-c940-40ae-aa12-68371cbf281c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:08.382320 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5d7d2f7-c940-40ae-aa12-68371cbf281c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:08.383020 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5d7d2f7-c940-40ae-aa12-68371cbf281c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:08.383667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5d7d2f7-c940-40ae-aa12-68371cbf281c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:08.384591 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5d7d2f7-c940-40ae-aa12-68371cbf281c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:08.385259 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5d7d2f7-c940-40ae-aa12-68371cbf281c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:08.385893 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a5d7d2f7-c940-40ae-aa12-68371cbf281c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:08.827329 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a5d7d2f7-c940-40ae-aa12-68371cbf281c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:08.837425 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-a5d7d2f7-c940-40ae-aa12-68371cbf281c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1259 microversion: 2.1 time: 0.467436 Aug 26 18:31:08.838240 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 490/992] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:08 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1259 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:31:09.858132 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f4ecc3f8-2012-4bae-8f15-8589e806b38f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:09.859264 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f4ecc3f8-2012-4bae-8f15-8589e806b38f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:09.872168 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ecc3f8-2012-4bae-8f15-8589e806b38f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:09.872604 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ecc3f8-2012-4bae-8f15-8589e806b38f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:09.873560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ecc3f8-2012-4bae-8f15-8589e806b38f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:09.874472 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ecc3f8-2012-4bae-8f15-8589e806b38f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:09.875195 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ecc3f8-2012-4bae-8f15-8589e806b38f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:09.875837 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ecc3f8-2012-4bae-8f15-8589e806b38f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:10.052297 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f4ecc3f8-2012-4bae-8f15-8589e806b38f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:10.066288 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f4ecc3f8-2012-4bae-8f15-8589e806b38f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1259 microversion: 2.1 time: 0.211722 Aug 26 18:31:10.076888 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 503/993] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:09 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:11.089023 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f062ae2a-3f8b-4197-91cb-acab25669295 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:11.089718 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-f062ae2a-3f8b-4197-91cb-acab25669295 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:11.097295 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f062ae2a-3f8b-4197-91cb-acab25669295 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:11.097777 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f062ae2a-3f8b-4197-91cb-acab25669295 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:11.098204 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f062ae2a-3f8b-4197-91cb-acab25669295 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:11.098901 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f062ae2a-3f8b-4197-91cb-acab25669295 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:11.099344 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f062ae2a-3f8b-4197-91cb-acab25669295 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:11.099808 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-f062ae2a-3f8b-4197-91cb-acab25669295 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:11.266363 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-f062ae2a-3f8b-4197-91cb-acab25669295 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:11.278464 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f062ae2a-3f8b-4197-91cb-acab25669295 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1259 microversion: 2.1 time: 0.194844 Aug 26 18:31:11.279451 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 491/994] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:11 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:12.301274 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-86af352b-e7f0-4709-9d0d-386d0b48e23f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:12.301882 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-86af352b-e7f0-4709-9d0d-386d0b48e23f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:12.304537 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:12.305891 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:12.318917 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86af352b-e7f0-4709-9d0d-386d0b48e23f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:12.319414 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86af352b-e7f0-4709-9d0d-386d0b48e23f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:12.319989 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86af352b-e7f0-4709-9d0d-386d0b48e23f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:12.320553 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86af352b-e7f0-4709-9d0d-386d0b48e23f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:12.321038 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86af352b-e7f0-4709-9d0d-386d0b48e23f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:12.321465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86af352b-e7f0-4709-9d0d-386d0b48e23f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:12.494059 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-86af352b-e7f0-4709-9d0d-386d0b48e23f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:12.509566 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-86af352b-e7f0-4709-9d0d-386d0b48e23f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1259 microversion: 2.1 time: 0.212071 Aug 26 18:31:12.512877 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 504/995] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:12 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:13.530920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-3d14d58c-234b-49c9-b91d-2b7d3fa9315b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:13.531750 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-3d14d58c-234b-49c9-b91d-2b7d3fa9315b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:13.535326 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:13.536120 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:13.542290 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d14d58c-234b-49c9-b91d-2b7d3fa9315b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:13.542824 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d14d58c-234b-49c9-b91d-2b7d3fa9315b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:13.543328 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d14d58c-234b-49c9-b91d-2b7d3fa9315b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:13.544110 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d14d58c-234b-49c9-b91d-2b7d3fa9315b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:13.544630 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d14d58c-234b-49c9-b91d-2b7d3fa9315b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:13.545281 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3d14d58c-234b-49c9-b91d-2b7d3fa9315b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:13.551463 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:13.759516 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3d14d58c-234b-49c9-b91d-2b7d3fa9315b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:13.768762 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-3d14d58c-234b-49c9-b91d-2b7d3fa9315b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1259 microversion: 2.1 time: 0.241748 Aug 26 18:31:13.770842 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 492/996] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:13 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1259 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:14.789991 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-194ca7e2-26c8-467d-aad4-c8b83b47c56f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:14.790526 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-194ca7e2-26c8-467d-aad4-c8b83b47c56f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:14.792951 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:14.798439 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-194ca7e2-26c8-467d-aad4-c8b83b47c56f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:14.798920 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-194ca7e2-26c8-467d-aad4-c8b83b47c56f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:14.799348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-194ca7e2-26c8-467d-aad4-c8b83b47c56f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:14.800036 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-194ca7e2-26c8-467d-aad4-c8b83b47c56f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:14.800486 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-194ca7e2-26c8-467d-aad4-c8b83b47c56f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:14.800923 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-194ca7e2-26c8-467d-aad4-c8b83b47c56f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:15.034643 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-194ca7e2-26c8-467d-aad4-c8b83b47c56f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:15.043021 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-194ca7e2-26c8-467d-aad4-c8b83b47c56f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1259 microversion: 2.1 time: 0.256873 Aug 26 18:31:15.043703 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 505/997] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:14 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1259 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:16.065435 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-324810db-51a5-48ed-a6a6-ce2a8ea2a007 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:16.067347 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-324810db-51a5-48ed-a6a6-ce2a8ea2a007 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:16.077669 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-324810db-51a5-48ed-a6a6-ce2a8ea2a007 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:16.078179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-324810db-51a5-48ed-a6a6-ce2a8ea2a007 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:16.078988 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-324810db-51a5-48ed-a6a6-ce2a8ea2a007 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:16.079919 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-324810db-51a5-48ed-a6a6-ce2a8ea2a007 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:16.080512 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-324810db-51a5-48ed-a6a6-ce2a8ea2a007 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:16.080920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-324810db-51a5-48ed-a6a6-ce2a8ea2a007 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:16.236618 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1269217097", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1811114461", "security_groups": [{"name": "tempest-secgroup-smoke-1399502428"}], "block_device_mapping_v2": [{"uuid": "8b4789b0-0d14-4ae7-ab65-1f117e550d8d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a8763208-a644-423d-b288-ce6ba4bfee8d"}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:31:16.276695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-324810db-51a5-48ed-a6a6-ce2a8ea2a007 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:16.288151 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-324810db-51a5-48ed-a6a6-ce2a8ea2a007 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1259 microversion: 2.1 time: 0.227306 Aug 26 18:31:16.292771 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 493/998] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:16 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:16.388927 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] validate_networks() for [('a8763208-a644-423d-b288-ce6ba4bfee8d', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:31:17.052840 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:31:17.053259 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:31:17.053722 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:31:17.054248 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:31:17.054771 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:31:17.064386 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:17.065028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:17.065534 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:17.066328 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:17.066772 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:17.067194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:17.087581 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Getting quotas for project 44c9832086724954853fc474a2a92747. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:31:17.091988 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Getting quotas for user deb80cf02c84476182960a91d69b6da1 and project 44c9832086724954853fc474a2a92747. Resources: {'cores', 'instances', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:31:17.160791 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:31:17.163054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b4789b0-0d14-4ae7-ab65-1f117e550d8d',volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:31:17.257547 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-3a31334e-ef69-4118-b7a9-a7c4e82fa03b req-d00eefcf-6166-4511-a834-3f83a653bc7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a74e4cb-8108-4101-8dbe-c063481f2967", "name": "network-vif-plugged", "status": "completed", "tag": "9b7f8fc1-6d04-4211-ab6a-e06a963d8464"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:31:17.269602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-3a31334e-ef69-4118-b7a9-a7c4e82fa03b req-d00eefcf-6166-4511-a834-3f83a653bc7f service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:17.270450 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-3a31334e-ef69-4118-b7a9-a7c4e82fa03b req-d00eefcf-6166-4511-a834-3f83a653bc7f service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:17.271117 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-3a31334e-ef69-4118-b7a9-a7c4e82fa03b req-d00eefcf-6166-4511-a834-3f83a653bc7f service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:17.284301 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-3a31334e-ef69-4118-b7a9-a7c4e82fa03b req-d00eefcf-6166-4511-a834-3f83a653bc7f service nova] Creating event network-vif-plugged:9b7f8fc1-6d04-4211-ab6a-e06a963d8464 for instance 8a74e4cb-8108-4101-8dbe-c063481f2967 on hv-cinder-85199 Aug 26 18:31:17.296212 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-3a31334e-ef69-4118-b7a9-a7c4e82fa03b req-d00eefcf-6166-4511-a834-3f83a653bc7f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042215 Aug 26 18:31:17.297973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 494/999] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:31:17.311555 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-63f1d42d-ae25-417a-abe9-0f7dd1f5b37a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:17.312470 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-63f1d42d-ae25-417a-abe9-0f7dd1f5b37a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:17.320125 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63f1d42d-ae25-417a-abe9-0f7dd1f5b37a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:17.320987 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63f1d42d-ae25-417a-abe9-0f7dd1f5b37a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:17.321798 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63f1d42d-ae25-417a-abe9-0f7dd1f5b37a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:17.322735 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63f1d42d-ae25-417a-abe9-0f7dd1f5b37a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:17.323816 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63f1d42d-ae25-417a-abe9-0f7dd1f5b37a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:17.324528 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-63f1d42d-ae25-417a-abe9-0f7dd1f5b37a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:17.361949 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e2c41e19-1cc3-4fc7-84b2-63c06a1890b5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.129559 Aug 26 18:31:17.364087 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 506/1000] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:31:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 18:31:17.377622 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6b50648b-ede8-4d63-987b-11d7f58072a5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:17.379319 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6b50648b-ede8-4d63-987b-11d7f58072a5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:17.485161 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6b50648b-ede8-4d63-987b-11d7f58072a5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:17.500020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6b50648b-ede8-4d63-987b-11d7f58072a5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1095 microversion: 2.1 time: 0.127425 Aug 26 18:31:17.501719 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 507/1001] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:17 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1095 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:31:17.558021 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-63f1d42d-ae25-417a-abe9-0f7dd1f5b37a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:17.568025 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-63f1d42d-ae25-417a-abe9-0f7dd1f5b37a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1259 microversion: 2.1 time: 0.262474 Aug 26 18:31:17.581367 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 495/1002] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:17 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1259 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:18.528906 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0d6a227b-1784-4cee-8bc3-653b2d6b544c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:18.529518 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0d6a227b-1784-4cee-8bc3-653b2d6b544c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:18.536126 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d6a227b-1784-4cee-8bc3-653b2d6b544c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:18.536606 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d6a227b-1784-4cee-8bc3-653b2d6b544c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:18.537065 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d6a227b-1784-4cee-8bc3-653b2d6b544c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:18.537749 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d6a227b-1784-4cee-8bc3-653b2d6b544c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:18.538211 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d6a227b-1784-4cee-8bc3-653b2d6b544c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:18.538616 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d6a227b-1784-4cee-8bc3-653b2d6b544c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:18.591649 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e211615d-3242-4a57-9e44-f75e2dfb6613 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:18.592446 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e211615d-3242-4a57-9e44-f75e2dfb6613 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:18.598934 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e211615d-3242-4a57-9e44-f75e2dfb6613 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:18.599538 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e211615d-3242-4a57-9e44-f75e2dfb6613 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:18.600075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e211615d-3242-4a57-9e44-f75e2dfb6613 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:18.600941 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e211615d-3242-4a57-9e44-f75e2dfb6613 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:18.601491 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e211615d-3242-4a57-9e44-f75e2dfb6613 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:18.602008 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e211615d-3242-4a57-9e44-f75e2dfb6613 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:18.605842 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0d6a227b-1784-4cee-8bc3-653b2d6b544c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:18.622425 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0d6a227b-1784-4cee-8bc3-653b2d6b544c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1193 microversion: 2.1 time: 0.097274 Aug 26 18:31:18.623458 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 508/1003] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:18 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:18.773954 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e211615d-3242-4a57-9e44-f75e2dfb6613 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:18.783059 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e211615d-3242-4a57-9e44-f75e2dfb6613 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1259 microversion: 2.1 time: 0.195158 Aug 26 18:31:18.783922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 496/1004] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:18 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:31:19.643415 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e643f498-9ea1-485a-8457-857bdbe81cc3 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:19.644061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e643f498-9ea1-485a-8457-857bdbe81cc3 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:19.650776 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e643f498-9ea1-485a-8457-857bdbe81cc3 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:19.651295 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e643f498-9ea1-485a-8457-857bdbe81cc3 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:19.651727 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e643f498-9ea1-485a-8457-857bdbe81cc3 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:19.652423 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e643f498-9ea1-485a-8457-857bdbe81cc3 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:19.652984 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e643f498-9ea1-485a-8457-857bdbe81cc3 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:19.653468 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e643f498-9ea1-485a-8457-857bdbe81cc3 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:19.723560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e643f498-9ea1-485a-8457-857bdbe81cc3 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:19.731575 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e643f498-9ea1-485a-8457-857bdbe81cc3 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1211 microversion: 2.1 time: 0.092225 Aug 26 18:31:19.732392 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 509/1005] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:19 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:19.805602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-a7cc9870-3fd9-453b-abe3-ecad0f91385a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:19.807318 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-a7cc9870-3fd9-453b-abe3-ecad0f91385a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:19.815362 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a7cc9870-3fd9-453b-abe3-ecad0f91385a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:19.815925 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a7cc9870-3fd9-453b-abe3-ecad0f91385a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:19.816419 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a7cc9870-3fd9-453b-abe3-ecad0f91385a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:19.817255 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a7cc9870-3fd9-453b-abe3-ecad0f91385a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:19.817778 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a7cc9870-3fd9-453b-abe3-ecad0f91385a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:19.818256 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a7cc9870-3fd9-453b-abe3-ecad0f91385a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:20.042220 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a7cc9870-3fd9-453b-abe3-ecad0f91385a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:20.049987 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-a7cc9870-3fd9-453b-abe3-ecad0f91385a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1443 microversion: 2.1 time: 0.248838 Aug 26 18:31:20.055004 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 497/1006] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:19 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1443 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:20.071070 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-764d321f-3d77-4865-9b6c-478baceea252 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:20.071685 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-764d321f-3d77-4865-9b6c-478baceea252 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:20.088902 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-764d321f-3d77-4865-9b6c-478baceea252 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:20.089416 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-764d321f-3d77-4865-9b6c-478baceea252 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:20.089876 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-764d321f-3d77-4865-9b6c-478baceea252 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:20.090616 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-764d321f-3d77-4865-9b6c-478baceea252 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:20.091186 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-764d321f-3d77-4865-9b6c-478baceea252 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:20.091952 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-764d321f-3d77-4865-9b6c-478baceea252 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:20.266554 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-764d321f-3d77-4865-9b6c-478baceea252 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:20.275044 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-764d321f-3d77-4865-9b6c-478baceea252 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1443 microversion: 2.1 time: 0.208588 Aug 26 18:31:20.291345 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 510/1007] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:20 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1443 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:20.755487 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-a3afcc89-63f4-432d-b37b-001a5dd5820f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:20.756123 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-a3afcc89-63f4-432d-b37b-001a5dd5820f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:20.763018 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a3afcc89-63f4-432d-b37b-001a5dd5820f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:20.763691 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a3afcc89-63f4-432d-b37b-001a5dd5820f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:20.764538 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a3afcc89-63f4-432d-b37b-001a5dd5820f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:20.765456 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a3afcc89-63f4-432d-b37b-001a5dd5820f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:20.766124 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a3afcc89-63f4-432d-b37b-001a5dd5820f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:20.766702 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-a3afcc89-63f4-432d-b37b-001a5dd5820f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:21.010065 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-a3afcc89-63f4-432d-b37b-001a5dd5820f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:21.021437 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-a3afcc89-63f4-432d-b37b-001a5dd5820f tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1267 microversion: 2.1 time: 0.271559 Aug 26 18:31:21.022222 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 498/1008] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:20 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:21.079478 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-fd3d2d8d-6e89-464d-8acc-042edc1bb8bb req-6efecfd7-abe1-479e-b3dd-d2e35fcfefbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a3495c2-c921-4efe-afad-e88277a31c16", "tag": "aced4124-9fe4-48fc-ab9c-bf8fdebb6384"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:31:21.090275 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-fd3d2d8d-6e89-464d-8acc-042edc1bb8bb req-6efecfd7-abe1-479e-b3dd-d2e35fcfefbe service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:21.090757 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-fd3d2d8d-6e89-464d-8acc-042edc1bb8bb req-6efecfd7-abe1-479e-b3dd-d2e35fcfefbe service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:21.091183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-fd3d2d8d-6e89-464d-8acc-042edc1bb8bb req-6efecfd7-abe1-479e-b3dd-d2e35fcfefbe service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:21.115743 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-fd3d2d8d-6e89-464d-8acc-042edc1bb8bb req-6efecfd7-abe1-479e-b3dd-d2e35fcfefbe service nova] Creating event network-changed:aced4124-9fe4-48fc-ab9c-bf8fdebb6384 for instance 6a3495c2-c921-4efe-afad-e88277a31c16 on hv-cinder-85199 Aug 26 18:31:21.122714 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-fd3d2d8d-6e89-464d-8acc-042edc1bb8bb req-6efecfd7-abe1-479e-b3dd-d2e35fcfefbe service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047043 Aug 26 18:31:21.123334 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 511/1009] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:31:22.044083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e107da56-090f-4653-af09-6ed29ef79c86 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:22.045600 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e107da56-090f-4653-af09-6ed29ef79c86 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:22.053570 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e107da56-090f-4653-af09-6ed29ef79c86 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:22.054311 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e107da56-090f-4653-af09-6ed29ef79c86 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:22.054895 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e107da56-090f-4653-af09-6ed29ef79c86 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:22.055772 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e107da56-090f-4653-af09-6ed29ef79c86 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:22.056868 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e107da56-090f-4653-af09-6ed29ef79c86 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:22.057498 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e107da56-090f-4653-af09-6ed29ef79c86 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:22.312274 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e107da56-090f-4653-af09-6ed29ef79c86 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:22.329024 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e107da56-090f-4653-af09-6ed29ef79c86 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1267 microversion: 2.1 time: 0.289364 Aug 26 18:31:22.341883 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 499/1010] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:22 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1267 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:22.476970 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-e1d1664d-54a2-4b1b-a736-cd7bc2bc6665 req-b678d82d-b6d0-4619-becf-4b085d2d9d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a74e4cb-8108-4101-8dbe-c063481f2967", "tag": "9b7f8fc1-6d04-4211-ab6a-e06a963d8464"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:31:22.491367 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e1d1664d-54a2-4b1b-a736-cd7bc2bc6665 req-b678d82d-b6d0-4619-becf-4b085d2d9d1b service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:22.492072 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e1d1664d-54a2-4b1b-a736-cd7bc2bc6665 req-b678d82d-b6d0-4619-becf-4b085d2d9d1b service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:22.493017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e1d1664d-54a2-4b1b-a736-cd7bc2bc6665 req-b678d82d-b6d0-4619-becf-4b085d2d9d1b service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:22.521054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-e1d1664d-54a2-4b1b-a736-cd7bc2bc6665 req-b678d82d-b6d0-4619-becf-4b085d2d9d1b service nova] Creating event network-changed:9b7f8fc1-6d04-4211-ab6a-e06a963d8464 for instance 8a74e4cb-8108-4101-8dbe-c063481f2967 on hv-cinder-85199 Aug 26 18:31:22.527217 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-e1d1664d-54a2-4b1b-a736-cd7bc2bc6665 req-b678d82d-b6d0-4619-becf-4b085d2d9d1b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055155 Aug 26 18:31:22.528005 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 512/1011] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:31:23.355504 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-dc3bdff2-7f2c-4265-92a7-cc6f36a8e786 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:23.356050 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-dc3bdff2-7f2c-4265-92a7-cc6f36a8e786 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:23.362741 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc3bdff2-7f2c-4265-92a7-cc6f36a8e786 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:23.363234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc3bdff2-7f2c-4265-92a7-cc6f36a8e786 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:23.363667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc3bdff2-7f2c-4265-92a7-cc6f36a8e786 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:23.364371 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc3bdff2-7f2c-4265-92a7-cc6f36a8e786 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:23.364875 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc3bdff2-7f2c-4265-92a7-cc6f36a8e786 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:23.365284 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-dc3bdff2-7f2c-4265-92a7-cc6f36a8e786 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:23.516067 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-dc3bdff2-7f2c-4265-92a7-cc6f36a8e786 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:23.523259 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-dc3bdff2-7f2c-4265-92a7-cc6f36a8e786 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1267 microversion: 2.1 time: 0.171723 Aug 26 18:31:23.530207 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 500/1012] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:23 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:24.552872 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f64c9c5a-1f2f-436a-b311-d1a00f869239 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:24.553565 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f64c9c5a-1f2f-436a-b311-d1a00f869239 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:24.560175 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f64c9c5a-1f2f-436a-b311-d1a00f869239 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:24.560655 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f64c9c5a-1f2f-436a-b311-d1a00f869239 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:24.561129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f64c9c5a-1f2f-436a-b311-d1a00f869239 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:24.561893 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f64c9c5a-1f2f-436a-b311-d1a00f869239 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:24.562259 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f64c9c5a-1f2f-436a-b311-d1a00f869239 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:24.562659 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f64c9c5a-1f2f-436a-b311-d1a00f869239 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:24.699048 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f64c9c5a-1f2f-436a-b311-d1a00f869239 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:24.707515 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f64c9c5a-1f2f-436a-b311-d1a00f869239 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1267 microversion: 2.1 time: 0.160204 Aug 26 18:31:24.708115 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 513/1013] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:24 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:25.727761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c327c7c6-debb-46bf-bbdc-5e0633d3b96d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:25.728297 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c327c7c6-debb-46bf-bbdc-5e0633d3b96d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:25.735082 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c327c7c6-debb-46bf-bbdc-5e0633d3b96d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:25.735567 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c327c7c6-debb-46bf-bbdc-5e0633d3b96d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:25.735999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c327c7c6-debb-46bf-bbdc-5e0633d3b96d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:25.736760 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c327c7c6-debb-46bf-bbdc-5e0633d3b96d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:25.737203 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c327c7c6-debb-46bf-bbdc-5e0633d3b96d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:25.737625 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c327c7c6-debb-46bf-bbdc-5e0633d3b96d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:25.875949 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c327c7c6-debb-46bf-bbdc-5e0633d3b96d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:25.885739 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c327c7c6-debb-46bf-bbdc-5e0633d3b96d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1267 microversion: 2.1 time: 0.161934 Aug 26 18:31:25.886807 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 501/1014] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:25 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:26.907535 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bbba3817-67bc-4963-9c93-6a82a53ab3fd tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:26.909868 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bbba3817-67bc-4963-9c93-6a82a53ab3fd tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:26.916275 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbba3817-67bc-4963-9c93-6a82a53ab3fd tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:26.916805 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbba3817-67bc-4963-9c93-6a82a53ab3fd tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:26.917244 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbba3817-67bc-4963-9c93-6a82a53ab3fd tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:26.917950 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbba3817-67bc-4963-9c93-6a82a53ab3fd tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:26.918457 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbba3817-67bc-4963-9c93-6a82a53ab3fd tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:26.918880 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbba3817-67bc-4963-9c93-6a82a53ab3fd tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:27.055246 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bbba3817-67bc-4963-9c93-6a82a53ab3fd tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:27.063240 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bbba3817-67bc-4963-9c93-6a82a53ab3fd tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1267 microversion: 2.1 time: 0.159709 Aug 26 18:31:27.063909 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 514/1015] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:26 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:28.085401 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-efaf4171-aa47-4d6c-bac2-5ac1f6413823 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:28.086422 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-efaf4171-aa47-4d6c-bac2-5ac1f6413823 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:28.093183 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-efaf4171-aa47-4d6c-bac2-5ac1f6413823 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:28.093632 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-efaf4171-aa47-4d6c-bac2-5ac1f6413823 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:28.094058 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-efaf4171-aa47-4d6c-bac2-5ac1f6413823 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:28.094794 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-efaf4171-aa47-4d6c-bac2-5ac1f6413823 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:28.095215 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-efaf4171-aa47-4d6c-bac2-5ac1f6413823 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:28.095650 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-efaf4171-aa47-4d6c-bac2-5ac1f6413823 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:28.242390 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-efaf4171-aa47-4d6c-bac2-5ac1f6413823 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:28.254600 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-efaf4171-aa47-4d6c-bac2-5ac1f6413823 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1267 microversion: 2.1 time: 0.173139 Aug 26 18:31:28.255577 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 502/1016] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:28 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:29.275864 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2186f885-8494-4508-8809-822bc9e07666 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:29.276816 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2186f885-8494-4508-8809-822bc9e07666 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:29.279244 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:29.280091 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=8 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:29.288247 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2186f885-8494-4508-8809-822bc9e07666 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:29.288247 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2186f885-8494-4508-8809-822bc9e07666 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:29.288247 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2186f885-8494-4508-8809-822bc9e07666 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:29.288949 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2186f885-8494-4508-8809-822bc9e07666 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:29.289603 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2186f885-8494-4508-8809-822bc9e07666 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:29.290027 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2186f885-8494-4508-8809-822bc9e07666 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:29.461645 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2186f885-8494-4508-8809-822bc9e07666 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:29.470632 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2186f885-8494-4508-8809-822bc9e07666 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1267 microversion: 2.1 time: 0.199296 Aug 26 18:31:29.471836 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 515/1017] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:29 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:30.492041 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7394e1d5-39cd-4bed-a33f-d7acf6bd6c96 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:30.492698 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-7394e1d5-39cd-4bed-a33f-d7acf6bd6c96 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:30.499922 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7394e1d5-39cd-4bed-a33f-d7acf6bd6c96 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:30.505879 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7394e1d5-39cd-4bed-a33f-d7acf6bd6c96 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:30.505879 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7394e1d5-39cd-4bed-a33f-d7acf6bd6c96 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:30.505879 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7394e1d5-39cd-4bed-a33f-d7acf6bd6c96 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:30.505879 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7394e1d5-39cd-4bed-a33f-d7acf6bd6c96 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:30.506562 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7394e1d5-39cd-4bed-a33f-d7acf6bd6c96 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:30.640647 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-7394e1d5-39cd-4bed-a33f-d7acf6bd6c96 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:30.648966 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-7394e1d5-39cd-4bed-a33f-d7acf6bd6c96 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1267 microversion: 2.1 time: 0.160770 Aug 26 18:31:30.649379 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 503/1018] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:30 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:31.370758 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-47bb1867-8dc2-4fb5-9bef-af4401b4aa94 req-a8609118-5359-4ec1-9f73-b18615cd35b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a3495c2-c921-4efe-afad-e88277a31c16", "name": "network-vif-plugged", "status": "completed", "tag": "aced4124-9fe4-48fc-ab9c-bf8fdebb6384"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:31:31.381201 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-47bb1867-8dc2-4fb5-9bef-af4401b4aa94 req-a8609118-5359-4ec1-9f73-b18615cd35b8 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:31.381709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-47bb1867-8dc2-4fb5-9bef-af4401b4aa94 req-a8609118-5359-4ec1-9f73-b18615cd35b8 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:31.382157 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-47bb1867-8dc2-4fb5-9bef-af4401b4aa94 req-a8609118-5359-4ec1-9f73-b18615cd35b8 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:31.394491 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-47bb1867-8dc2-4fb5-9bef-af4401b4aa94 req-a8609118-5359-4ec1-9f73-b18615cd35b8 service nova] Creating event network-vif-plugged:aced4124-9fe4-48fc-ab9c-bf8fdebb6384 for instance 6a3495c2-c921-4efe-afad-e88277a31c16 on hv-cinder-85199 Aug 26 18:31:31.400405 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-47bb1867-8dc2-4fb5-9bef-af4401b4aa94 req-a8609118-5359-4ec1-9f73-b18615cd35b8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033020 Aug 26 18:31:31.401191 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 516/1019] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:31:31.670690 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-68e7ae66-b312-4c19-ba18-7a76aafbd0e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:31.671358 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-68e7ae66-b312-4c19-ba18-7a76aafbd0e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:31.678668 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68e7ae66-b312-4c19-ba18-7a76aafbd0e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:31.679179 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68e7ae66-b312-4c19-ba18-7a76aafbd0e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:31.679639 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68e7ae66-b312-4c19-ba18-7a76aafbd0e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:31.680384 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68e7ae66-b312-4c19-ba18-7a76aafbd0e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:31.680888 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68e7ae66-b312-4c19-ba18-7a76aafbd0e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:31.681353 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-68e7ae66-b312-4c19-ba18-7a76aafbd0e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:31.821936 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-68e7ae66-b312-4c19-ba18-7a76aafbd0e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:31.832904 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-68e7ae66-b312-4c19-ba18-7a76aafbd0e9 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1267 microversion: 2.1 time: 0.166561 Aug 26 18:31:31.833441 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 504/1020] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:31 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:32.856534 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-006dab3b-f444-461c-90bd-acb08a8e0287 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:32.857387 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-006dab3b-f444-461c-90bd-acb08a8e0287 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:32.866055 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-006dab3b-f444-461c-90bd-acb08a8e0287 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:32.866470 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-006dab3b-f444-461c-90bd-acb08a8e0287 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:32.866897 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-006dab3b-f444-461c-90bd-acb08a8e0287 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:32.867583 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-006dab3b-f444-461c-90bd-acb08a8e0287 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:32.868025 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-006dab3b-f444-461c-90bd-acb08a8e0287 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:32.868440 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-006dab3b-f444-461c-90bd-acb08a8e0287 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:33.015138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-006dab3b-f444-461c-90bd-acb08a8e0287 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:33.023054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-006dab3b-f444-461c-90bd-acb08a8e0287 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1267 microversion: 2.1 time: 0.172553 Aug 26 18:31:33.023630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 517/1021] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:32 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:34.048414 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-59293036-8a67-4ad6-b890-fc4df4544b4a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:34.049452 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-59293036-8a67-4ad6-b890-fc4df4544b4a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:34.056536 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-59293036-8a67-4ad6-b890-fc4df4544b4a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:34.057059 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-59293036-8a67-4ad6-b890-fc4df4544b4a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:34.057488 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-59293036-8a67-4ad6-b890-fc4df4544b4a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:34.058182 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-59293036-8a67-4ad6-b890-fc4df4544b4a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:34.058665 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-59293036-8a67-4ad6-b890-fc4df4544b4a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:34.059098 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-59293036-8a67-4ad6-b890-fc4df4544b4a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:34.197108 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-59293036-8a67-4ad6-b890-fc4df4544b4a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:34.205316 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-59293036-8a67-4ad6-b890-fc4df4544b4a tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1267 microversion: 2.1 time: 0.163660 Aug 26 18:31:34.205893 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 505/1022] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:34 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:35.228993 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fa908ee5-6419-4dbe-ab9b-cf7406680ea2 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:35.229881 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fa908ee5-6419-4dbe-ab9b-cf7406680ea2 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:35.240273 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa908ee5-6419-4dbe-ab9b-cf7406680ea2 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:35.240776 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa908ee5-6419-4dbe-ab9b-cf7406680ea2 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:35.241239 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa908ee5-6419-4dbe-ab9b-cf7406680ea2 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:35.241934 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa908ee5-6419-4dbe-ab9b-cf7406680ea2 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:35.242385 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa908ee5-6419-4dbe-ab9b-cf7406680ea2 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:35.242812 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa908ee5-6419-4dbe-ab9b-cf7406680ea2 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:35.385442 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fa908ee5-6419-4dbe-ab9b-cf7406680ea2 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:35.387843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=83 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:31:35.394246 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fa908ee5-6419-4dbe-ab9b-cf7406680ea2 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1267 microversion: 2.1 time: 0.171609 Aug 26 18:31:35.394794 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 518/1023] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:35 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:36.416031 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ade02233-c48f-4d12-a687-b22963d4e2f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:36.416656 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ade02233-c48f-4d12-a687-b22963d4e2f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:36.423354 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ade02233-c48f-4d12-a687-b22963d4e2f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:36.423850 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ade02233-c48f-4d12-a687-b22963d4e2f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:36.424279 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ade02233-c48f-4d12-a687-b22963d4e2f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:36.425000 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ade02233-c48f-4d12-a687-b22963d4e2f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:36.425448 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ade02233-c48f-4d12-a687-b22963d4e2f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:36.425867 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ade02233-c48f-4d12-a687-b22963d4e2f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:36.578357 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ade02233-c48f-4d12-a687-b22963d4e2f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:36.586308 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ade02233-c48f-4d12-a687-b22963d4e2f5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1454 microversion: 2.1 time: 0.174526 Aug 26 18:31:36.586876 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 506/1024] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:36 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:36.607884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6e6100c1-b95d-4456-a30c-9908ee9171cc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:31:36.608588 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6e6100c1-b95d-4456-a30c-9908ee9171cc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:31:36.615746 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e6100c1-b95d-4456-a30c-9908ee9171cc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:36.616440 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e6100c1-b95d-4456-a30c-9908ee9171cc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:36.616974 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e6100c1-b95d-4456-a30c-9908ee9171cc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:36.617602 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e6100c1-b95d-4456-a30c-9908ee9171cc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:36.618108 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e6100c1-b95d-4456-a30c-9908ee9171cc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:36.618699 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e6100c1-b95d-4456-a30c-9908ee9171cc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:36.757176 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6e6100c1-b95d-4456-a30c-9908ee9171cc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:31:36.766259 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6e6100c1-b95d-4456-a30c-9908ee9171cc tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1454 microversion: 2.1 time: 0.162465 Aug 26 18:31:36.766911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 519/1025] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:31:36 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:31:38.598292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-ae3b1578-45d4-4074-ac5b-b0bedcbca4cc req-d1144674-8968-4544-ae85-d6f7fce45b28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a3495c2-c921-4efe-afad-e88277a31c16", "tag": "aced4124-9fe4-48fc-ab9c-bf8fdebb6384"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:31:38.608638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ae3b1578-45d4-4074-ac5b-b0bedcbca4cc req-d1144674-8968-4544-ae85-d6f7fce45b28 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:31:38.609354 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ae3b1578-45d4-4074-ac5b-b0bedcbca4cc req-d1144674-8968-4544-ae85-d6f7fce45b28 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:31:38.609970 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-ae3b1578-45d4-4074-ac5b-b0bedcbca4cc req-d1144674-8968-4544-ae85-d6f7fce45b28 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:31:38.621508 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-ae3b1578-45d4-4074-ac5b-b0bedcbca4cc req-d1144674-8968-4544-ae85-d6f7fce45b28 service nova] Creating event network-changed:aced4124-9fe4-48fc-ab9c-bf8fdebb6384 for instance 6a3495c2-c921-4efe-afad-e88277a31c16 on hv-cinder-85199 Aug 26 18:31:38.626641 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-ae3b1578-45d4-4074-ac5b-b0bedcbca4cc req-d1144674-8968-4544-ae85-d6f7fce45b28 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032000 Aug 26 18:31:38.627232 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 507/1026] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:32:12.604342 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9bd37b6c-ace2-462b-9017-7d52e90b154c tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Action: 'create', calling method: .version_select at 0x7fc7442bc0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-527312819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi20ehD8u0oqxd/0ypsYU0/ltumWNKOlPhXcJeoNWz4UhgvNvw+FzoWOi1TFLSNA/pOw0xdp9VvH4aRdC+jTtvJD+6hf0A3U0a3VMgQwU+wCa9XcfaxNONObPhD9gnlpw=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:32:12.612014 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:12.612702 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=7 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:12.624653 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-9bd37b6c-ace2-462b-9017-7d52e90b154c tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Getting quotas for project c26abe1c65a24c8796880a82af3627e0. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:32:12.629436 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-9bd37b6c-ace2-462b-9017-7d52e90b154c tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Getting quotas for user 6fc89be7205648b889aeaa6b072d641b and project c26abe1c65a24c8796880a82af3627e0. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:32:12.655723 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9bd37b6c-ace2-462b-9017-7d52e90b154c tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055525 Aug 26 18:32:12.656380 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 520/1027] 10.222.0.45 () {60 vars in 1159 bytes} [Fri Aug 26 18:32:12 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:32:12.765203 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=31 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:12.765958 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=87 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:12.771518 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1339018184", "imageRef": "eed98e5a-c46a-493a-b417-b34774613567", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-527312819", "networks": [{"uuid": "4a685e9e-6394-4f5b-9971-d3fdf262a216"}]}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:32:12.827973 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.network.neutron [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] validate_networks() for [('4a685e9e-6394-4f5b-9971-d3fdf262a216', None, None, None, None, None)] {{(pid=120540) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 18:32:13.243254 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Flavor limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 18:32:13.244064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Image limits 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 18:32:13.244913 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Flavor pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 18:32:13.245562 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Image pref 0:0:0 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 18:32:13.246219 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.virt.hardware [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 18:32:13.257539 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:13.258024 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:13.258453 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:13.259169 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:13.259622 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:13.260126 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:13.279706 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Getting quotas for project c26abe1c65a24c8796880a82af3627e0. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 18:32:13.284856 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.quota [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Getting quotas for user 6fc89be7205648b889aeaa6b072d641b and project c26abe1c65a24c8796880a82af3627e0. Resources: {'cores', 'instances', 'ram'} {{(pid=120540) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 18:32:13.298430 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Going to run 1 instances... {{(pid=120540) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 18:32:13.300873 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eed98e5a-c46a-493a-b417-b34774613567',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120540) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 18:32:13.349372 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-fdd377ef-9458-42b0-ad8e-4e5d7059aa25 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585837 Aug 26 18:32:13.350385 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 508/1028] 10.222.0.45 () {60 vars in 1147 bytes} [Fri Aug 26 18:32:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 18:32:13.361920 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-470b5dae-f6c2-4aef-99eb-4b3594a60b58 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:13.363491 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-470b5dae-f6c2-4aef-99eb-4b3594a60b58 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:13.442327 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-470b5dae-f6c2-4aef-99eb-4b3594a60b58 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:13.451348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-470b5dae-f6c2-4aef-99eb-4b3594a60b58 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1258 microversion: 2.1 time: 0.094272 Aug 26 18:32:13.452036 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 521/1029] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:13 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1258 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:14.473028 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1abb2a64-138e-4d53-8a43-898cc77133bb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:14.473989 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1abb2a64-138e-4d53-8a43-898cc77133bb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:14.482092 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1abb2a64-138e-4d53-8a43-898cc77133bb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:14.482984 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1abb2a64-138e-4d53-8a43-898cc77133bb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:14.483998 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1abb2a64-138e-4d53-8a43-898cc77133bb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:14.484862 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1abb2a64-138e-4d53-8a43-898cc77133bb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:14.485313 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1abb2a64-138e-4d53-8a43-898cc77133bb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:14.485735 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1abb2a64-138e-4d53-8a43-898cc77133bb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:14.565376 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1abb2a64-138e-4d53-8a43-898cc77133bb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:14.573646 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1abb2a64-138e-4d53-8a43-898cc77133bb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1310 microversion: 2.1 time: 0.105760 Aug 26 18:32:14.574625 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 509/1030] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:14 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1310 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:32:15.596334 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5d643278-8b46-4bad-a06f-20499b9bb1a3 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:15.597009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5d643278-8b46-4bad-a06f-20499b9bb1a3 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:15.627892 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d643278-8b46-4bad-a06f-20499b9bb1a3 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:15.634026 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d643278-8b46-4bad-a06f-20499b9bb1a3 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:15.634718 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d643278-8b46-4bad-a06f-20499b9bb1a3 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:15.635741 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d643278-8b46-4bad-a06f-20499b9bb1a3 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:15.641044 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d643278-8b46-4bad-a06f-20499b9bb1a3 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:15.642351 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d643278-8b46-4bad-a06f-20499b9bb1a3 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:15.894571 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5d643278-8b46-4bad-a06f-20499b9bb1a3 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:15.922958 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5d643278-8b46-4bad-a06f-20499b9bb1a3 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1358 microversion: 2.1 time: 0.325097 Aug 26 18:32:15.924181 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 522/1031] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:15 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1358 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:16.947153 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-5d36b4d3-b884-482a-b8ad-af38ef1b7873 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:16.947815 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-5d36b4d3-b884-482a-b8ad-af38ef1b7873 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:16.955363 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5d36b4d3-b884-482a-b8ad-af38ef1b7873 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:16.955856 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5d36b4d3-b884-482a-b8ad-af38ef1b7873 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:16.956292 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5d36b4d3-b884-482a-b8ad-af38ef1b7873 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:16.957243 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5d36b4d3-b884-482a-b8ad-af38ef1b7873 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:16.957892 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5d36b4d3-b884-482a-b8ad-af38ef1b7873 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:16.958505 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5d36b4d3-b884-482a-b8ad-af38ef1b7873 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:17.134316 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-5d36b4d3-b884-482a-b8ad-af38ef1b7873 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:17.142199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-5d36b4d3-b884-482a-b8ad-af38ef1b7873 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1358 microversion: 2.1 time: 0.199849 Aug 26 18:32:17.142758 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 510/1032] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:16 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:32:18.163215 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fb7f5bef-5943-4488-9983-64e7107a4bd5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:18.163999 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fb7f5bef-5943-4488-9983-64e7107a4bd5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:18.171060 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb7f5bef-5943-4488-9983-64e7107a4bd5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:18.171544 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb7f5bef-5943-4488-9983-64e7107a4bd5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:18.171969 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb7f5bef-5943-4488-9983-64e7107a4bd5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:18.172663 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb7f5bef-5943-4488-9983-64e7107a4bd5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:18.173146 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb7f5bef-5943-4488-9983-64e7107a4bd5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:18.173562 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb7f5bef-5943-4488-9983-64e7107a4bd5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:18.324577 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fb7f5bef-5943-4488-9983-64e7107a4bd5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:18.334889 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fb7f5bef-5943-4488-9983-64e7107a4bd5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1358 microversion: 2.1 time: 0.175809 Aug 26 18:32:18.335552 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 523/1033] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:18 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:19.355753 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-eb708e65-fbc1-45f5-b72f-1da3d57d20f6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:19.356370 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-eb708e65-fbc1-45f5-b72f-1da3d57d20f6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:19.363271 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb708e65-fbc1-45f5-b72f-1da3d57d20f6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:19.363759 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb708e65-fbc1-45f5-b72f-1da3d57d20f6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:19.364189 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb708e65-fbc1-45f5-b72f-1da3d57d20f6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:19.364920 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb708e65-fbc1-45f5-b72f-1da3d57d20f6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:19.365375 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb708e65-fbc1-45f5-b72f-1da3d57d20f6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:19.365794 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb708e65-fbc1-45f5-b72f-1da3d57d20f6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:19.522186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-eb708e65-fbc1-45f5-b72f-1da3d57d20f6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:19.530120 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-eb708e65-fbc1-45f5-b72f-1da3d57d20f6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1358 microversion: 2.1 time: 0.178405 Aug 26 18:32:19.530684 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 511/1034] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:19 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:20.550456 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ccc6daed-eab4-46cc-ad44-3f5dee10d996 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:20.551290 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ccc6daed-eab4-46cc-ad44-3f5dee10d996 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:20.558617 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccc6daed-eab4-46cc-ad44-3f5dee10d996 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:20.558868 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccc6daed-eab4-46cc-ad44-3f5dee10d996 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:20.559335 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccc6daed-eab4-46cc-ad44-3f5dee10d996 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:20.560004 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccc6daed-eab4-46cc-ad44-3f5dee10d996 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:20.560456 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccc6daed-eab4-46cc-ad44-3f5dee10d996 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:20.561012 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccc6daed-eab4-46cc-ad44-3f5dee10d996 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:20.777091 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ccc6daed-eab4-46cc-ad44-3f5dee10d996 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:20.786861 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ccc6daed-eab4-46cc-ad44-3f5dee10d996 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1358 microversion: 2.1 time: 0.240187 Aug 26 18:32:20.787457 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 524/1035] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:20 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:32:21.811893 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e84e26b3-c424-4513-a6b0-31d85014ab56 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:21.812488 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e84e26b3-c424-4513-a6b0-31d85014ab56 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:21.821566 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e84e26b3-c424-4513-a6b0-31d85014ab56 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:21.822234 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e84e26b3-c424-4513-a6b0-31d85014ab56 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:21.823606 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e84e26b3-c424-4513-a6b0-31d85014ab56 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:21.824844 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e84e26b3-c424-4513-a6b0-31d85014ab56 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:21.825778 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e84e26b3-c424-4513-a6b0-31d85014ab56 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:21.827020 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e84e26b3-c424-4513-a6b0-31d85014ab56 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:21.993697 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e84e26b3-c424-4513-a6b0-31d85014ab56 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:22.002083 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e84e26b3-c424-4513-a6b0-31d85014ab56 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1358 microversion: 2.1 time: 0.196008 Aug 26 18:32:22.002666 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 512/1036] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:21 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:23.024055 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e70a8c39-e974-4e5e-96b2-f355296985c4 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:23.024763 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e70a8c39-e974-4e5e-96b2-f355296985c4 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:23.032577 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e70a8c39-e974-4e5e-96b2-f355296985c4 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:23.033222 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e70a8c39-e974-4e5e-96b2-f355296985c4 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:23.033659 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e70a8c39-e974-4e5e-96b2-f355296985c4 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:23.034367 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e70a8c39-e974-4e5e-96b2-f355296985c4 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:23.034803 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e70a8c39-e974-4e5e-96b2-f355296985c4 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:23.035228 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e70a8c39-e974-4e5e-96b2-f355296985c4 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:23.180131 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e70a8c39-e974-4e5e-96b2-f355296985c4 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:23.188768 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e70a8c39-e974-4e5e-96b2-f355296985c4 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1358 microversion: 2.1 time: 0.169162 Aug 26 18:32:23.189560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 525/1037] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:23 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:24.209464 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d74453d9-ac7c-42ab-8233-c3196f5ec651 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:24.210077 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-d74453d9-ac7c-42ab-8233-c3196f5ec651 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:24.213700 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:24.214585 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=6 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:24.219844 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d74453d9-ac7c-42ab-8233-c3196f5ec651 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:24.220654 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d74453d9-ac7c-42ab-8233-c3196f5ec651 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:24.221331 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d74453d9-ac7c-42ab-8233-c3196f5ec651 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:24.222101 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d74453d9-ac7c-42ab-8233-c3196f5ec651 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:24.222744 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d74453d9-ac7c-42ab-8233-c3196f5ec651 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:24.223225 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d74453d9-ac7c-42ab-8233-c3196f5ec651 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:24.495921 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d74453d9-ac7c-42ab-8233-c3196f5ec651 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:24.510681 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-d74453d9-ac7c-42ab-8233-c3196f5ec651 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1358 microversion: 2.1 time: 0.304806 Aug 26 18:32:24.522824 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 513/1038] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:24 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1358 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:24.632359 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-d991ba63-2f89-4b3d-a2cc-8ea1d9dd751f req-23346360-4120-4ba1-81f6-0b6b1ac2fc8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f0f651-94dd-4845-b0b7-3fc15bc5c2a2", "tag": "78fb9d16-e9c7-48e4-b391-d84d7b05ae6e"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:32:24.637784 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:24.645421 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d991ba63-2f89-4b3d-a2cc-8ea1d9dd751f req-23346360-4120-4ba1-81f6-0b6b1ac2fc8c service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:24.646261 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d991ba63-2f89-4b3d-a2cc-8ea1d9dd751f req-23346360-4120-4ba1-81f6-0b6b1ac2fc8c service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:24.647392 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d991ba63-2f89-4b3d-a2cc-8ea1d9dd751f req-23346360-4120-4ba1-81f6-0b6b1ac2fc8c service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:24.665069 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-d991ba63-2f89-4b3d-a2cc-8ea1d9dd751f req-23346360-4120-4ba1-81f6-0b6b1ac2fc8c service nova] Creating event network-changed:78fb9d16-e9c7-48e4-b391-d84d7b05ae6e for instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 on hv-cinder-85199 Aug 26 18:32:24.671651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-d991ba63-2f89-4b3d-a2cc-8ea1d9dd751f req-23346360-4120-4ba1-81f6-0b6b1ac2fc8c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043672 Aug 26 18:32:24.672789 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 526/1039] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:32:25.531999 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-84ec1114-30af-4018-9716-0949e4c07835 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:25.532618 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-84ec1114-30af-4018-9716-0949e4c07835 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:25.539635 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-84ec1114-30af-4018-9716-0949e4c07835 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:25.540113 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-84ec1114-30af-4018-9716-0949e4c07835 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:25.540534 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-84ec1114-30af-4018-9716-0949e4c07835 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:25.541244 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-84ec1114-30af-4018-9716-0949e4c07835 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:25.541729 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-84ec1114-30af-4018-9716-0949e4c07835 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:25.542140 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-84ec1114-30af-4018-9716-0949e4c07835 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:25.682734 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-84ec1114-30af-4018-9716-0949e4c07835 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:25.690825 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-84ec1114-30af-4018-9716-0949e4c07835 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1358 microversion: 2.1 time: 0.162871 Aug 26 18:32:25.691395 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 514/1040] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:25 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:26.712569 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6d12e2de-0c12-422b-af30-3436fffaa99f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:26.713674 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6d12e2de-0c12-422b-af30-3436fffaa99f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:26.720181 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d12e2de-0c12-422b-af30-3436fffaa99f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:26.720671 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d12e2de-0c12-422b-af30-3436fffaa99f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:26.721129 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d12e2de-0c12-422b-af30-3436fffaa99f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:26.721828 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d12e2de-0c12-422b-af30-3436fffaa99f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:26.722273 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d12e2de-0c12-422b-af30-3436fffaa99f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:26.722694 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d12e2de-0c12-422b-af30-3436fffaa99f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:26.861917 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6d12e2de-0c12-422b-af30-3436fffaa99f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:26.870340 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6d12e2de-0c12-422b-af30-3436fffaa99f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1358 microversion: 2.1 time: 0.162734 Aug 26 18:32:26.871088 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 527/1041] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:26 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:27.891418 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-85fc273f-b6cc-4218-ba7f-8810b7170d72 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:27.892017 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-85fc273f-b6cc-4218-ba7f-8810b7170d72 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:27.900467 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-85fc273f-b6cc-4218-ba7f-8810b7170d72 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:27.901094 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-85fc273f-b6cc-4218-ba7f-8810b7170d72 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:27.901670 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-85fc273f-b6cc-4218-ba7f-8810b7170d72 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:27.902307 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-85fc273f-b6cc-4218-ba7f-8810b7170d72 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:27.902751 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-85fc273f-b6cc-4218-ba7f-8810b7170d72 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:27.903206 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-85fc273f-b6cc-4218-ba7f-8810b7170d72 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:28.035046 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-85fc273f-b6cc-4218-ba7f-8810b7170d72 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:28.043582 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-85fc273f-b6cc-4218-ba7f-8810b7170d72 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1358 microversion: 2.1 time: 0.156027 Aug 26 18:32:28.044421 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 515/1042] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:27 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:29.063912 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eaf6f039-3087-4cb8-b2a2-e0b6336c4588 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:29.064578 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eaf6f039-3087-4cb8-b2a2-e0b6336c4588 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:29.071658 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaf6f039-3087-4cb8-b2a2-e0b6336c4588 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:29.072144 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaf6f039-3087-4cb8-b2a2-e0b6336c4588 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:29.072572 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaf6f039-3087-4cb8-b2a2-e0b6336c4588 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:29.073374 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaf6f039-3087-4cb8-b2a2-e0b6336c4588 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:29.073809 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaf6f039-3087-4cb8-b2a2-e0b6336c4588 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:29.074243 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaf6f039-3087-4cb8-b2a2-e0b6336c4588 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:29.209636 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eaf6f039-3087-4cb8-b2a2-e0b6336c4588 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:29.218159 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eaf6f039-3087-4cb8-b2a2-e0b6336c4588 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1358 microversion: 2.1 time: 0.158118 Aug 26 18:32:29.218744 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 528/1043] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:29 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:29.616462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-2de7e742-ae29-409b-825a-5e75312865fe req-9001a7e9-2f14-473b-8c74-eb819b4e491d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f0f651-94dd-4845-b0b7-3fc15bc5c2a2", "name": "network-vif-plugged", "status": "completed", "tag": "78fb9d16-e9c7-48e4-b391-d84d7b05ae6e"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:32:29.627696 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2de7e742-ae29-409b-825a-5e75312865fe req-9001a7e9-2f14-473b-8c74-eb819b4e491d service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:29.628370 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2de7e742-ae29-409b-825a-5e75312865fe req-9001a7e9-2f14-473b-8c74-eb819b4e491d service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:29.635785 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-2de7e742-ae29-409b-825a-5e75312865fe req-9001a7e9-2f14-473b-8c74-eb819b4e491d service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:29.651217 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-2de7e742-ae29-409b-825a-5e75312865fe req-9001a7e9-2f14-473b-8c74-eb819b4e491d service nova] Creating event network-vif-plugged:78fb9d16-e9c7-48e4-b391-d84d7b05ae6e for instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 on hv-cinder-85199 Aug 26 18:32:29.657056 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-2de7e742-ae29-409b-825a-5e75312865fe req-9001a7e9-2f14-473b-8c74-eb819b4e491d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045034 Aug 26 18:32:29.657733 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 516/1044] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:32:30.239276 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eb7f984e-7604-45d2-861d-074d40131114 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:30.239862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eb7f984e-7604-45d2-861d-074d40131114 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:30.246762 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb7f984e-7604-45d2-861d-074d40131114 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:30.247724 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb7f984e-7604-45d2-861d-074d40131114 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:30.248167 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb7f984e-7604-45d2-861d-074d40131114 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:30.249018 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb7f984e-7604-45d2-861d-074d40131114 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:30.249603 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb7f984e-7604-45d2-861d-074d40131114 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:30.250009 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb7f984e-7604-45d2-861d-074d40131114 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:30.413139 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eb7f984e-7604-45d2-861d-074d40131114 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:30.424109 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eb7f984e-7604-45d2-861d-074d40131114 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1358 microversion: 2.1 time: 0.188648 Aug 26 18:32:30.424698 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 529/1045] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:30 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:31.450309 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-1d7b1985-5d4a-474d-b466-7772bcf99bd2 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:31.451074 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-1d7b1985-5d4a-474d-b466-7772bcf99bd2 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:31.457828 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d7b1985-5d4a-474d-b466-7772bcf99bd2 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:31.458300 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d7b1985-5d4a-474d-b466-7772bcf99bd2 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:31.458749 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d7b1985-5d4a-474d-b466-7772bcf99bd2 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:31.459442 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d7b1985-5d4a-474d-b466-7772bcf99bd2 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:31.459903 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d7b1985-5d4a-474d-b466-7772bcf99bd2 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:31.460319 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-1d7b1985-5d4a-474d-b466-7772bcf99bd2 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:31.604411 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-1d7b1985-5d4a-474d-b466-7772bcf99bd2 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:31.612643 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-1d7b1985-5d4a-474d-b466-7772bcf99bd2 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1548 microversion: 2.1 time: 0.168175 Aug 26 18:32:31.613783 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 517/1046] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:31 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:31.633248 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f68fb24f-3d56-4ff8-9c3e-7c52385cf1e6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:31.633948 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f68fb24f-3d56-4ff8-9c3e-7c52385cf1e6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:31.640453 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f68fb24f-3d56-4ff8-9c3e-7c52385cf1e6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:31.641048 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f68fb24f-3d56-4ff8-9c3e-7c52385cf1e6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:31.641579 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f68fb24f-3d56-4ff8-9c3e-7c52385cf1e6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:31.642358 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f68fb24f-3d56-4ff8-9c3e-7c52385cf1e6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:31.642880 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f68fb24f-3d56-4ff8-9c3e-7c52385cf1e6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:31.643311 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f68fb24f-3d56-4ff8-9c3e-7c52385cf1e6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:31.780278 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f68fb24f-3d56-4ff8-9c3e-7c52385cf1e6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:31.788696 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f68fb24f-3d56-4ff8-9c3e-7c52385cf1e6 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1548 microversion: 2.1 time: 0.159597 Aug 26 18:32:31.789330 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 530/1047] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:31 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:31.808687 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-07087165-c3a5-4772-8b6d-28f32d60a7fd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:31.813623 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-07087165-c3a5-4772-8b6d-28f32d60a7fd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:31.814386 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-07087165-c3a5-4772-8b6d-28f32d60a7fd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Searching by: {'deleted': False, 'project_id': 'c26abe1c65a24c8796880a82af3627e0'} {{(pid=120540) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 26 18:32:31.821295 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-07087165-c3a5-4772-8b6d-28f32d60a7fd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:31.821774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-07087165-c3a5-4772-8b6d-28f32d60a7fd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:31.822216 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-07087165-c3a5-4772-8b6d-28f32d60a7fd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:31.823078 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-07087165-c3a5-4772-8b6d-28f32d60a7fd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:31.823509 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-07087165-c3a5-4772-8b6d-28f32d60a7fd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:31.823943 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-07087165-c3a5-4772-8b6d-28f32d60a7fd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:31.918161 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.multi_cell_list [None req-07087165-c3a5-4772-8b6d-28f32d60a7fd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120540) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 26 18:32:32.018420 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-07087165-c3a5-4772-8b6d-28f32d60a7fd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213460 Aug 26 18:32:32.018996 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 518/1048] 10.222.0.45 () {58 vars in 1125 bytes} [Fri Aug 26 18:32:31 2022] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:32:32.030679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a70979a7-4e8b-49b8-a772-59dc3967c56e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:32.031269 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a70979a7-4e8b-49b8-a772-59dc3967c56e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:32.037729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a70979a7-4e8b-49b8-a772-59dc3967c56e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:32.038185 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a70979a7-4e8b-49b8-a772-59dc3967c56e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:32.038640 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a70979a7-4e8b-49b8-a772-59dc3967c56e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:32.039504 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a70979a7-4e8b-49b8-a772-59dc3967c56e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:32.040137 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a70979a7-4e8b-49b8-a772-59dc3967c56e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:32.040554 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a70979a7-4e8b-49b8-a772-59dc3967c56e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:32.208342 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a70979a7-4e8b-49b8-a772-59dc3967c56e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:32.221777 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a70979a7-4e8b-49b8-a772-59dc3967c56e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1548 microversion: 2.1 time: 0.194585 Aug 26 18:32:32.222829 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 531/1049] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:32 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1548 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:33.867787 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-7abf5612-1b69-46cd-86c3-185fc903724a tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea6d5839-4282-43c5-a535-66204ca07b91"}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:32:33.870336 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-7abf5612-1b69-46cd-86c3-185fc903724a tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:33.877172 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7abf5612-1b69-46cd-86c3-185fc903724a tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:33.877667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7abf5612-1b69-46cd-86c3-185fc903724a tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:33.878098 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7abf5612-1b69-46cd-86c3-185fc903724a tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:33.878791 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7abf5612-1b69-46cd-86c3-185fc903724a tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:33.879226 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7abf5612-1b69-46cd-86c3-185fc903724a tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:33.879643 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-7abf5612-1b69-46cd-86c3-185fc903724a tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:34.151831 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-7abf5612-1b69-46cd-86c3-185fc903724a tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "POST /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287941 Aug 26 18:32:34.152446 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 519/1050] 10.222.0.45 () {60 vars in 1323 bytes} [Fri Aug 26 18:32:33 2022] POST /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:32:41.804758 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a62509ba-9759-43d4-b82d-6b3fc2cf2453 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:41.805500 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a62509ba-9759-43d4-b82d-6b3fc2cf2453 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:41.815185 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a62509ba-9759-43d4-b82d-6b3fc2cf2453 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:41.815690 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a62509ba-9759-43d4-b82d-6b3fc2cf2453 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:41.816118 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a62509ba-9759-43d4-b82d-6b3fc2cf2453 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:41.816895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a62509ba-9759-43d4-b82d-6b3fc2cf2453 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:41.817320 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a62509ba-9759-43d4-b82d-6b3fc2cf2453 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:41.817741 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a62509ba-9759-43d4-b82d-6b3fc2cf2453 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:41.966272 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a62509ba-9759-43d4-b82d-6b3fc2cf2453 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:41.978161 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a62509ba-9759-43d4-b82d-6b3fc2cf2453 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1594 microversion: 2.1 time: 0.177114 Aug 26 18:32:41.979088 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 532/1051] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:41 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1594 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:32:44.165345 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-c9d2e4a3-971c-424e-a830-ef8a084f9f45 req-efbed734-aa9e-43f7-9075-07ebed2f9906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f0f651-94dd-4845-b0b7-3fc15bc5c2a2", "tag": "78fb9d16-e9c7-48e4-b391-d84d7b05ae6e"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:32:44.181131 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell0:SELECT=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:44.182781 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:44.184878 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:44.198310 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-c9d2e4a3-971c-424e-a830-ef8a084f9f45 req-efbed734-aa9e-43f7-9075-07ebed2f9906 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:44.199690 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-c9d2e4a3-971c-424e-a830-ef8a084f9f45 req-efbed734-aa9e-43f7-9075-07ebed2f9906 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:44.200516 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-c9d2e4a3-971c-424e-a830-ef8a084f9f45 req-efbed734-aa9e-43f7-9075-07ebed2f9906 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:44.226627 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-c9d2e4a3-971c-424e-a830-ef8a084f9f45 req-efbed734-aa9e-43f7-9075-07ebed2f9906 service nova] Creating event network-changed:78fb9d16-e9c7-48e4-b391-d84d7b05ae6e for instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 on hv-cinder-85199 Aug 26 18:32:44.238795 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-c9d2e4a3-971c-424e-a830-ef8a084f9f45 req-efbed734-aa9e-43f7-9075-07ebed2f9906 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081137 Aug 26 18:32:44.239788 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 520/1052] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:32:45.740422 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-df8ee600-95c1-4465-8597-911d697de074 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1863540207"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:32:45.741302 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-df8ee600-95c1-4465-8597-911d697de074 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:45.743468 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:45.749337 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df8ee600-95c1-4465-8597-911d697de074 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:45.749825 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df8ee600-95c1-4465-8597-911d697de074 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:45.750261 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df8ee600-95c1-4465-8597-911d697de074 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:45.750951 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df8ee600-95c1-4465-8597-911d697de074 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:45.751396 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df8ee600-95c1-4465-8597-911d697de074 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:45.751813 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df8ee600-95c1-4465-8597-911d697de074 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:45.755464 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=63 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:32:45.900872 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.network.security_group_api [None req-df8ee600-95c1-4465-8597-911d697de074 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Adding security group 0a7baf8a-dc61-4e71-b7a5-0e9be19f39bc to port 78fb9d16-e9c7-48e4-b391-d84d7b05ae6e Aug 26 18:32:46.276325 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-df8ee600-95c1-4465-8597-911d697de074 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "POST /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/action" status: 202 len: 0 microversion: 2.1 time: 0.538220 Aug 26 18:32:46.276862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 533/1053] 10.222.0.45 () {60 vars in 1278 bytes} [Fri Aug 26 18:32:45 2022] POST /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:32:46.287298 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-4be5f054-0e17-4fec-aee8-cf7afa1d244d req-975d5bec-5f1a-4e65-9322-121db1b8797d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f0f651-94dd-4845-b0b7-3fc15bc5c2a2", "tag": "78fb9d16-e9c7-48e4-b391-d84d7b05ae6e"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:32:46.292495 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-eb6432d1-adc8-4a3d-8d94-03dd4d720a6c tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:32:46.294604 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-eb6432d1-adc8-4a3d-8d94-03dd4d720a6c tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:32:46.297721 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-4be5f054-0e17-4fec-aee8-cf7afa1d244d req-975d5bec-5f1a-4e65-9322-121db1b8797d service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:46.298398 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-4be5f054-0e17-4fec-aee8-cf7afa1d244d req-975d5bec-5f1a-4e65-9322-121db1b8797d service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:46.298977 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-4be5f054-0e17-4fec-aee8-cf7afa1d244d req-975d5bec-5f1a-4e65-9322-121db1b8797d service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:46.308177 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb6432d1-adc8-4a3d-8d94-03dd4d720a6c tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:46.309570 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb6432d1-adc8-4a3d-8d94-03dd4d720a6c tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:46.310313 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb6432d1-adc8-4a3d-8d94-03dd4d720a6c tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:46.311643 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb6432d1-adc8-4a3d-8d94-03dd4d720a6c tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:32:46.312344 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb6432d1-adc8-4a3d-8d94-03dd4d720a6c tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:32:46.313431 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-eb6432d1-adc8-4a3d-8d94-03dd4d720a6c tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:32:46.318919 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-4be5f054-0e17-4fec-aee8-cf7afa1d244d req-975d5bec-5f1a-4e65-9322-121db1b8797d service nova] Creating event network-changed:78fb9d16-e9c7-48e4-b391-d84d7b05ae6e for instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 on hv-cinder-85199 Aug 26 18:32:46.325789 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-4be5f054-0e17-4fec-aee8-cf7afa1d244d req-975d5bec-5f1a-4e65-9322-121db1b8797d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042574 Aug 26 18:32:46.326843 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 534/1054] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:32:46.620818 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-eb6432d1-adc8-4a3d-8d94-03dd4d720a6c tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:32:46.635531 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-eb6432d1-adc8-4a3d-8d94-03dd4d720a6c tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1759 microversion: 2.1 time: 0.353563 Aug 26 18:32:46.636819 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 521/1055] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:32:46 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1759 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:09.300655 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:33:09.301521 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=5 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:33:09.306292 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b9912823-71d5-4941-a0a8-743f482ac7a7 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:33:09.308903 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b9912823-71d5-4941-a0a8-743f482ac7a7 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:09.317354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9912823-71d5-4941-a0a8-743f482ac7a7 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:09.317907 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9912823-71d5-4941-a0a8-743f482ac7a7 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:09.318366 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9912823-71d5-4941-a0a8-743f482ac7a7 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:09.319136 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9912823-71d5-4941-a0a8-743f482ac7a7 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:09.319645 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9912823-71d5-4941-a0a8-743f482ac7a7 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:09.320107 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9912823-71d5-4941-a0a8-743f482ac7a7 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:09.409744 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b9912823-71d5-4941-a0a8-743f482ac7a7 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "POST /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/action" status: 202 len: 0 microversion: 2.1 time: 0.110670 Aug 26 18:33:09.410525 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 535/1056] 10.222.0.45 () {60 vars in 1278 bytes} [Fri Aug 26 18:33:09 2022] POST /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:33:09.420951 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-2d3f195b-9e6c-45d4-a828-9c315c673846 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:09.422300 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-2d3f195b-9e6c-45d4-a828-9c315c673846 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:09.423951 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=4 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:33:09.424634 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=8 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:33:09.430612 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d3f195b-9e6c-45d4-a828-9c315c673846 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:09.431099 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d3f195b-9e6c-45d4-a828-9c315c673846 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:09.431637 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d3f195b-9e6c-45d4-a828-9c315c673846 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:09.432343 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d3f195b-9e6c-45d4-a828-9c315c673846 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:09.432858 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d3f195b-9e6c-45d4-a828-9c315c673846 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:09.433265 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-2d3f195b-9e6c-45d4-a828-9c315c673846 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:09.678641 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-2d3f195b-9e6c-45d4-a828-9c315c673846 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:09.687718 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-2d3f195b-9e6c-45d4-a828-9c315c673846 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1751 microversion: 2.1 time: 0.271521 Aug 26 18:33:09.688458 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 522/1057] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:09 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1751 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:10.715075 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ec3ff478-26cb-4b0a-b906-a9e79691324e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:10.715818 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ec3ff478-26cb-4b0a-b906-a9e79691324e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:10.723183 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec3ff478-26cb-4b0a-b906-a9e79691324e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:10.723952 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec3ff478-26cb-4b0a-b906-a9e79691324e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:10.724494 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec3ff478-26cb-4b0a-b906-a9e79691324e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:10.725388 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec3ff478-26cb-4b0a-b906-a9e79691324e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:10.725935 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec3ff478-26cb-4b0a-b906-a9e79691324e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:10.726459 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec3ff478-26cb-4b0a-b906-a9e79691324e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:10.918184 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ec3ff478-26cb-4b0a-b906-a9e79691324e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:10.929993 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ec3ff478-26cb-4b0a-b906-a9e79691324e tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1756 microversion: 2.1 time: 0.219881 Aug 26 18:33:10.930959 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 536/1058] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:10 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1756 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:11.957188 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0975a023-6054-4fbb-a630-b6f4fe27ab70 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:11.957938 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-0975a023-6054-4fbb-a630-b6f4fe27ab70 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:11.965621 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0975a023-6054-4fbb-a630-b6f4fe27ab70 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:11.966125 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0975a023-6054-4fbb-a630-b6f4fe27ab70 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:11.966577 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0975a023-6054-4fbb-a630-b6f4fe27ab70 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:11.967341 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0975a023-6054-4fbb-a630-b6f4fe27ab70 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:11.967816 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0975a023-6054-4fbb-a630-b6f4fe27ab70 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:11.968259 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0975a023-6054-4fbb-a630-b6f4fe27ab70 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:12.129513 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0975a023-6054-4fbb-a630-b6f4fe27ab70 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:12.138653 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-0975a023-6054-4fbb-a630-b6f4fe27ab70 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1756 microversion: 2.1 time: 0.185817 Aug 26 18:33:12.139269 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 523/1059] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:11 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:13.165131 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f524ea6d-4143-4347-8b02-92d4a9ac45ee tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:13.165975 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f524ea6d-4143-4347-8b02-92d4a9ac45ee tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:13.172757 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f524ea6d-4143-4347-8b02-92d4a9ac45ee tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:13.173253 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f524ea6d-4143-4347-8b02-92d4a9ac45ee tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:13.173687 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f524ea6d-4143-4347-8b02-92d4a9ac45ee tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:13.174386 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f524ea6d-4143-4347-8b02-92d4a9ac45ee tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:13.174831 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f524ea6d-4143-4347-8b02-92d4a9ac45ee tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:13.175247 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f524ea6d-4143-4347-8b02-92d4a9ac45ee tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:13.330186 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f524ea6d-4143-4347-8b02-92d4a9ac45ee tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:13.338973 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f524ea6d-4143-4347-8b02-92d4a9ac45ee tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1756 microversion: 2.1 time: 0.178726 Aug 26 18:33:13.339539 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 537/1060] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:13 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:14.360486 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-8bb94a84-1f4d-4b33-8d41-065c8332046b tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:14.361115 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-8bb94a84-1f4d-4b33-8d41-065c8332046b tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:14.369723 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8bb94a84-1f4d-4b33-8d41-065c8332046b tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:14.370400 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8bb94a84-1f4d-4b33-8d41-065c8332046b tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:14.370992 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8bb94a84-1f4d-4b33-8d41-065c8332046b tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:14.371886 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8bb94a84-1f4d-4b33-8d41-065c8332046b tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:14.372335 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8bb94a84-1f4d-4b33-8d41-065c8332046b tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:14.373140 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-8bb94a84-1f4d-4b33-8d41-065c8332046b tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:14.551443 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-8bb94a84-1f4d-4b33-8d41-065c8332046b tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:14.560129 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-8bb94a84-1f4d-4b33-8d41-065c8332046b tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1756 microversion: 2.1 time: 0.203674 Aug 26 18:33:14.560741 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 524/1061] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:14 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1756 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:15.583516 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-51085ab9-fc63-40fd-b539-1b0319a1f301 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:15.584204 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-51085ab9-fc63-40fd-b539-1b0319a1f301 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:15.591883 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51085ab9-fc63-40fd-b539-1b0319a1f301 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:15.592394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51085ab9-fc63-40fd-b539-1b0319a1f301 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:15.592868 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51085ab9-fc63-40fd-b539-1b0319a1f301 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:15.593641 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51085ab9-fc63-40fd-b539-1b0319a1f301 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:15.594115 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51085ab9-fc63-40fd-b539-1b0319a1f301 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:15.594549 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51085ab9-fc63-40fd-b539-1b0319a1f301 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:16.041538 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-51085ab9-fc63-40fd-b539-1b0319a1f301 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:16.050599 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-51085ab9-fc63-40fd-b539-1b0319a1f301 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1756 microversion: 2.1 time: 0.471516 Aug 26 18:33:16.051190 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 538/1062] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:15 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1756 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:33:17.075554 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c1cb8b4f-c29b-4bc0-a4c9-f8e3443de2cb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:17.076237 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c1cb8b4f-c29b-4bc0-a4c9-f8e3443de2cb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:17.084665 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1cb8b4f-c29b-4bc0-a4c9-f8e3443de2cb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:17.084665 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1cb8b4f-c29b-4bc0-a4c9-f8e3443de2cb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:17.085330 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1cb8b4f-c29b-4bc0-a4c9-f8e3443de2cb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:17.085888 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1cb8b4f-c29b-4bc0-a4c9-f8e3443de2cb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:17.086297 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1cb8b4f-c29b-4bc0-a4c9-f8e3443de2cb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:17.086712 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c1cb8b4f-c29b-4bc0-a4c9-f8e3443de2cb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:17.245851 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-c1cb8b4f-c29b-4bc0-a4c9-f8e3443de2cb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:17.254196 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c1cb8b4f-c29b-4bc0-a4c9-f8e3443de2cb tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1756 microversion: 2.1 time: 0.184165 Aug 26 18:33:17.254807 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 525/1063] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:17 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:18.281898 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8380487d-9353-490a-a227-615227709ed5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:18.282549 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8380487d-9353-490a-a227-615227709ed5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:18.290222 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8380487d-9353-490a-a227-615227709ed5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:18.290715 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8380487d-9353-490a-a227-615227709ed5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:18.291254 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8380487d-9353-490a-a227-615227709ed5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:18.291976 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8380487d-9353-490a-a227-615227709ed5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:18.292434 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8380487d-9353-490a-a227-615227709ed5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:18.292906 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8380487d-9353-490a-a227-615227709ed5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:18.458249 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8380487d-9353-490a-a227-615227709ed5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:18.467816 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8380487d-9353-490a-a227-615227709ed5 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1756 microversion: 2.1 time: 0.189993 Aug 26 18:33:18.468463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 539/1064] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:18 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:19.490825 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0298ee72-edf2-4369-90ee-605a00a3d824 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:19.491489 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-0298ee72-edf2-4369-90ee-605a00a3d824 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:19.498694 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0298ee72-edf2-4369-90ee-605a00a3d824 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:19.499221 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0298ee72-edf2-4369-90ee-605a00a3d824 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:19.499706 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0298ee72-edf2-4369-90ee-605a00a3d824 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:19.500457 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0298ee72-edf2-4369-90ee-605a00a3d824 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:19.500961 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0298ee72-edf2-4369-90ee-605a00a3d824 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:19.501407 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0298ee72-edf2-4369-90ee-605a00a3d824 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:19.698804 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0298ee72-edf2-4369-90ee-605a00a3d824 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:19.707799 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-0298ee72-edf2-4369-90ee-605a00a3d824 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1756 microversion: 2.1 time: 0.222086 Aug 26 18:33:19.708403 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 526/1065] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:19 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1756 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:20.729945 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c2a3f754-3b8b-4529-a4bd-d7f12af3a6bd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:20.730692 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c2a3f754-3b8b-4529-a4bd-d7f12af3a6bd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:20.740774 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2a3f754-3b8b-4529-a4bd-d7f12af3a6bd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:20.741429 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2a3f754-3b8b-4529-a4bd-d7f12af3a6bd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:20.742133 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2a3f754-3b8b-4529-a4bd-d7f12af3a6bd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:20.743301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2a3f754-3b8b-4529-a4bd-d7f12af3a6bd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:20.743938 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2a3f754-3b8b-4529-a4bd-d7f12af3a6bd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:20.744461 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2a3f754-3b8b-4529-a4bd-d7f12af3a6bd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:20.925895 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c2a3f754-3b8b-4529-a4bd-d7f12af3a6bd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:20.934977 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c2a3f754-3b8b-4529-a4bd-d7f12af3a6bd tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1756 microversion: 2.1 time: 0.208989 Aug 26 18:33:20.935651 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 540/1066] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:20 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1756 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:33:21.956851 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-d88a9c1f-6ece-45a5-bf09-10081f7a0430 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:21.957845 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-d88a9c1f-6ece-45a5-bf09-10081f7a0430 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:21.965480 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d88a9c1f-6ece-45a5-bf09-10081f7a0430 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:21.966079 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d88a9c1f-6ece-45a5-bf09-10081f7a0430 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:21.966786 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d88a9c1f-6ece-45a5-bf09-10081f7a0430 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:21.967507 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d88a9c1f-6ece-45a5-bf09-10081f7a0430 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:21.968125 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d88a9c1f-6ece-45a5-bf09-10081f7a0430 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:21.968550 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-d88a9c1f-6ece-45a5-bf09-10081f7a0430 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:22.143747 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-d88a9c1f-6ece-45a5-bf09-10081f7a0430 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:22.155375 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-d88a9c1f-6ece-45a5-bf09-10081f7a0430 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1756 microversion: 2.1 time: 0.202526 Aug 26 18:33:22.157171 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 527/1067] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:21 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1756 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:23.182237 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0628df80-14ad-463b-8cb2-7f55aba761fe tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:23.182872 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0628df80-14ad-463b-8cb2-7f55aba761fe tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:23.189665 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0628df80-14ad-463b-8cb2-7f55aba761fe tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:23.190145 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0628df80-14ad-463b-8cb2-7f55aba761fe tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:23.190569 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0628df80-14ad-463b-8cb2-7f55aba761fe tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:23.191255 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0628df80-14ad-463b-8cb2-7f55aba761fe tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:23.191705 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0628df80-14ad-463b-8cb2-7f55aba761fe tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:23.192117 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0628df80-14ad-463b-8cb2-7f55aba761fe tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:23.355049 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0628df80-14ad-463b-8cb2-7f55aba761fe tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:23.365955 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0628df80-14ad-463b-8cb2-7f55aba761fe tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1756 microversion: 2.1 time: 0.187527 Aug 26 18:33:23.366676 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 541/1068] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:23 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:24.387729 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4c6243c3-b848-48bd-a4da-987c5a92621f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:24.388301 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4c6243c3-b848-48bd-a4da-987c5a92621f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:24.394923 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4c6243c3-b848-48bd-a4da-987c5a92621f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:24.395410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4c6243c3-b848-48bd-a4da-987c5a92621f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:24.395834 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4c6243c3-b848-48bd-a4da-987c5a92621f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:24.396561 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4c6243c3-b848-48bd-a4da-987c5a92621f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:24.397227 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4c6243c3-b848-48bd-a4da-987c5a92621f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:24.397814 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4c6243c3-b848-48bd-a4da-987c5a92621f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:24.555631 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-4c6243c3-b848-48bd-a4da-987c5a92621f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:24.564069 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4c6243c3-b848-48bd-a4da-987c5a92621f tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1756 microversion: 2.1 time: 0.180460 Aug 26 18:33:24.564636 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 528/1069] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:24 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:25.585823 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1ebbf783-354a-4bbc-a4ae-e36b71578002 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:25.586575 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1ebbf783-354a-4bbc-a4ae-e36b71578002 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:25.596535 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ebbf783-354a-4bbc-a4ae-e36b71578002 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:25.597326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ebbf783-354a-4bbc-a4ae-e36b71578002 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:25.598002 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ebbf783-354a-4bbc-a4ae-e36b71578002 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:25.599095 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ebbf783-354a-4bbc-a4ae-e36b71578002 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:25.599822 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ebbf783-354a-4bbc-a4ae-e36b71578002 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:25.600502 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ebbf783-354a-4bbc-a4ae-e36b71578002 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:25.775818 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1ebbf783-354a-4bbc-a4ae-e36b71578002 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:25.786414 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1ebbf783-354a-4bbc-a4ae-e36b71578002 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1756 microversion: 2.1 time: 0.204483 Aug 26 18:33:25.787011 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 542/1070] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:25 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:26.808642 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0f27ced5-824e-4b67-9fec-c7d72bc5c727 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:26.809290 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-0f27ced5-824e-4b67-9fec-c7d72bc5c727 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:26.816338 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0f27ced5-824e-4b67-9fec-c7d72bc5c727 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:26.816863 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0f27ced5-824e-4b67-9fec-c7d72bc5c727 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:26.817334 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0f27ced5-824e-4b67-9fec-c7d72bc5c727 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:26.818011 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0f27ced5-824e-4b67-9fec-c7d72bc5c727 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:26.818476 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0f27ced5-824e-4b67-9fec-c7d72bc5c727 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:26.818886 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0f27ced5-824e-4b67-9fec-c7d72bc5c727 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:26.974329 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0f27ced5-824e-4b67-9fec-c7d72bc5c727 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:26.983387 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-0f27ced5-824e-4b67-9fec-c7d72bc5c727 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1759 microversion: 2.1 time: 0.178875 Aug 26 18:33:26.983983 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 529/1071] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:26 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1759 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:34.762124 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a15e12ba-e4ac-460e-8100-c439fc940bf7 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:33:34.762728 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a15e12ba-e4ac-460e-8100-c439fc940bf7 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:34.771961 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a15e12ba-e4ac-460e-8100-c439fc940bf7 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:34.772883 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a15e12ba-e4ac-460e-8100-c439fc940bf7 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:34.773526 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a15e12ba-e4ac-460e-8100-c439fc940bf7 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:34.774529 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a15e12ba-e4ac-460e-8100-c439fc940bf7 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:34.775126 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a15e12ba-e4ac-460e-8100-c439fc940bf7 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:34.775559 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a15e12ba-e4ac-460e-8100-c439fc940bf7 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:34.801294 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-a15e12ba-e4ac-460e-8100-c439fc940bf7 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lazy-loading 'flavor' on Instance uuid 8a74e4cb-8108-4101-8dbe-c063481f2967 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:33:34.891379 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-5ab2268c-7e14-4d23-b572-353f9c9f566d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:34.892202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-5ab2268c-7e14-4d23-b572-353f9c9f566d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:34.892305 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a15e12ba-e4ac-460e-8100-c439fc940bf7 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "POST /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967/action" status: 202 len: 0 microversion: 2.1 time: 0.133892 Aug 26 18:33:34.896871 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 543/1072] 10.222.0.45 () {60 vars in 1278 bytes} [Fri Aug 26 18:33:34 2022] POST /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:33:34.899410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5ab2268c-7e14-4d23-b572-353f9c9f566d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:34.899902 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5ab2268c-7e14-4d23-b572-353f9c9f566d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:34.900330 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5ab2268c-7e14-4d23-b572-353f9c9f566d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:34.900694 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-e2fe6cdb-f2b1-4dec-b576-68772df8ef6d req-14ff89e9-47c8-4173-b526-e876b203c6bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a3495c2-c921-4efe-afad-e88277a31c16", "tag": "aced4124-9fe4-48fc-ab9c-bf8fdebb6384"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:33:34.901030 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5ab2268c-7e14-4d23-b572-353f9c9f566d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:34.901658 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5ab2268c-7e14-4d23-b572-353f9c9f566d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:34.902273 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-5ab2268c-7e14-4d23-b572-353f9c9f566d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:34.911860 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e2fe6cdb-f2b1-4dec-b576-68772df8ef6d req-14ff89e9-47c8-4173-b526-e876b203c6bd service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:34.912668 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e2fe6cdb-f2b1-4dec-b576-68772df8ef6d req-14ff89e9-47c8-4173-b526-e876b203c6bd service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:34.913175 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e2fe6cdb-f2b1-4dec-b576-68772df8ef6d req-14ff89e9-47c8-4173-b526-e876b203c6bd service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:34.927178 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-e2fe6cdb-f2b1-4dec-b576-68772df8ef6d req-14ff89e9-47c8-4173-b526-e876b203c6bd service nova] Creating event network-changed:aced4124-9fe4-48fc-ab9c-bf8fdebb6384 for instance 6a3495c2-c921-4efe-afad-e88277a31c16 on hv-cinder-85199 Aug 26 18:33:34.933052 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-e2fe6cdb-f2b1-4dec-b576-68772df8ef6d req-14ff89e9-47c8-4173-b526-e876b203c6bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038827 Aug 26 18:33:34.933871 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 544/1073] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:33:34.942620 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-48486c29-6003-48db-af4a-187a66ad98a3 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:34.943376 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-48486c29-6003-48db-af4a-187a66ad98a3 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:34.949847 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-5ab2268c-7e14-4d23-b572-353f9c9f566d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Going to try to terminate instance {{(pid=120540) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:33:34.950221 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48486c29-6003-48db-af4a-187a66ad98a3 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:34.950714 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48486c29-6003-48db-af4a-187a66ad98a3 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:34.951139 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48486c29-6003-48db-af4a-187a66ad98a3 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:34.951837 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48486c29-6003-48db-af4a-187a66ad98a3 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:34.952287 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48486c29-6003-48db-af4a-187a66ad98a3 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:34.952704 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48486c29-6003-48db-af4a-187a66ad98a3 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:35.059860 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-5ab2268c-7e14-4d23-b572-353f9c9f566d tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 204 len: 0 microversion: 2.1 time: 0.172159 Aug 26 18:33:35.061231 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 530/1074] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:33:34 2022] DELETE /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:33:35.077263 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4629e494-ddc4-451e-9206-de2c05ae97a8 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:35.078321 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4629e494-ddc4-451e-9206-de2c05ae97a8 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:35.085935 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4629e494-ddc4-451e-9206-de2c05ae97a8 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:35.086755 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4629e494-ddc4-451e-9206-de2c05ae97a8 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:35.087364 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4629e494-ddc4-451e-9206-de2c05ae97a8 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:35.088227 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4629e494-ddc4-451e-9206-de2c05ae97a8 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:35.088967 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4629e494-ddc4-451e-9206-de2c05ae97a8 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:35.089543 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4629e494-ddc4-451e-9206-de2c05ae97a8 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:35.317295 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-48486c29-6003-48db-af4a-187a66ad98a3 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:35.326354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-48486c29-6003-48db-af4a-187a66ad98a3 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1567 microversion: 2.1 time: 0.388367 Aug 26 18:33:35.326941 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 545/1075] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:34 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1567 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:35.339436 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-4629e494-ddc4-451e-9206-de2c05ae97a8 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:35.349256 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4629e494-ddc4-451e-9206-de2c05ae97a8 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1579 microversion: 2.1 time: 0.279539 Aug 26 18:33:35.350000 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 531/1076] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:35 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1579 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:36.349767 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1b8a5efd-9254-4ff3-8f4c-41e99c286380 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:36.350423 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1b8a5efd-9254-4ff3-8f4c-41e99c286380 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:36.357622 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b8a5efd-9254-4ff3-8f4c-41e99c286380 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:36.358098 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b8a5efd-9254-4ff3-8f4c-41e99c286380 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:36.358518 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b8a5efd-9254-4ff3-8f4c-41e99c286380 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:36.359222 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b8a5efd-9254-4ff3-8f4c-41e99c286380 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:36.359689 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b8a5efd-9254-4ff3-8f4c-41e99c286380 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:36.360110 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b8a5efd-9254-4ff3-8f4c-41e99c286380 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:36.371770 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ff17a7b3-3212-4bbf-89a6-3e9afa8da381 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:36.372353 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ff17a7b3-3212-4bbf-89a6-3e9afa8da381 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:36.379545 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ff17a7b3-3212-4bbf-89a6-3e9afa8da381 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:36.380060 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ff17a7b3-3212-4bbf-89a6-3e9afa8da381 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:36.380461 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ff17a7b3-3212-4bbf-89a6-3e9afa8da381 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:36.381397 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ff17a7b3-3212-4bbf-89a6-3e9afa8da381 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:36.381848 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ff17a7b3-3212-4bbf-89a6-3e9afa8da381 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:36.382334 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ff17a7b3-3212-4bbf-89a6-3e9afa8da381 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:36.508002 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1b8a5efd-9254-4ff3-8f4c-41e99c286380 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:36.517795 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1b8a5efd-9254-4ff3-8f4c-41e99c286380 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1567 microversion: 2.1 time: 0.172091 Aug 26 18:33:36.523833 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 546/1077] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:36 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:36.596652 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ff17a7b3-3212-4bbf-89a6-3e9afa8da381 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:36.605322 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ff17a7b3-3212-4bbf-89a6-3e9afa8da381 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1579 microversion: 2.1 time: 0.237363 Aug 26 18:33:36.606006 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 532/1078] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:36 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1579 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:37.334151 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-99355860-55fb-4f3d-96c7-f6022b400474 req-f01f39fd-f730-4c7b-b4af-7a3d213e21a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a3495c2-c921-4efe-afad-e88277a31c16", "name": "network-vif-deleted", "tag": "aced4124-9fe4-48fc-ab9c-bf8fdebb6384"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:33:37.346856 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-99355860-55fb-4f3d-96c7-f6022b400474 req-f01f39fd-f730-4c7b-b4af-7a3d213e21a9 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:37.347350 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-99355860-55fb-4f3d-96c7-f6022b400474 req-f01f39fd-f730-4c7b-b4af-7a3d213e21a9 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:37.347770 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-99355860-55fb-4f3d-96c7-f6022b400474 req-f01f39fd-f730-4c7b-b4af-7a3d213e21a9 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:37.361082 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-99355860-55fb-4f3d-96c7-f6022b400474 req-f01f39fd-f730-4c7b-b4af-7a3d213e21a9 service nova] Creating event network-vif-deleted:aced4124-9fe4-48fc-ab9c-bf8fdebb6384 for instance 6a3495c2-c921-4efe-afad-e88277a31c16 on hv-cinder-85199 Aug 26 18:33:37.367890 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-99355860-55fb-4f3d-96c7-f6022b400474 req-f01f39fd-f730-4c7b-b4af-7a3d213e21a9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037137 Aug 26 18:33:37.368979 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 547/1079] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:33:37.540502 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-9de802e7-f4b8-4867-aabb-e105a68852c1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:37.541130 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-9de802e7-f4b8-4867-aabb-e105a68852c1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:37.548222 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9de802e7-f4b8-4867-aabb-e105a68852c1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:37.548742 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9de802e7-f4b8-4867-aabb-e105a68852c1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:37.549175 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9de802e7-f4b8-4867-aabb-e105a68852c1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:37.549896 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9de802e7-f4b8-4867-aabb-e105a68852c1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:37.550326 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9de802e7-f4b8-4867-aabb-e105a68852c1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:37.550774 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-9de802e7-f4b8-4867-aabb-e105a68852c1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:37.629859 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2b3fd041-8094-4645-a63c-43677f215468 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:37.630956 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2b3fd041-8094-4645-a63c-43677f215468 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:37.638403 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b3fd041-8094-4645-a63c-43677f215468 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:37.639294 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b3fd041-8094-4645-a63c-43677f215468 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:37.640672 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b3fd041-8094-4645-a63c-43677f215468 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:37.642143 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b3fd041-8094-4645-a63c-43677f215468 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:37.643233 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b3fd041-8094-4645-a63c-43677f215468 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:37.644130 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b3fd041-8094-4645-a63c-43677f215468 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:37.734392 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-9de802e7-f4b8-4867-aabb-e105a68852c1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:37.736079 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2b3fd041-8094-4645-a63c-43677f215468 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:37.743709 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-9de802e7-f4b8-4867-aabb-e105a68852c1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1567 microversion: 2.1 time: 0.207744 Aug 26 18:33:37.744604 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 533/1080] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:37 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:37.749550 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2b3fd041-8094-4645-a63c-43677f215468 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 200 len: 1226 microversion: 2.1 time: 0.125669 Aug 26 18:33:37.751710 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 548/1081] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:37 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 1226 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:33:38.767588 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-618ab7e5-cf79-4ee1-b508-b4bfc6e8fd57 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:38.768213 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-618ab7e5-cf79-4ee1-b508-b4bfc6e8fd57 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:38.771796 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-88a8a229-d110-43cd-95a7-b0269b1e501c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:38.772509 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-88a8a229-d110-43cd-95a7-b0269b1e501c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 6a3495c2-c921-4efe-afad-e88277a31c16] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:38.775906 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-618ab7e5-cf79-4ee1-b508-b4bfc6e8fd57 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:38.776408 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-618ab7e5-cf79-4ee1-b508-b4bfc6e8fd57 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:38.776951 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-618ab7e5-cf79-4ee1-b508-b4bfc6e8fd57 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:38.777544 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-618ab7e5-cf79-4ee1-b508-b4bfc6e8fd57 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:38.778007 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-618ab7e5-cf79-4ee1-b508-b4bfc6e8fd57 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:38.778419 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-618ab7e5-cf79-4ee1-b508-b4bfc6e8fd57 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:38.779899 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88a8a229-d110-43cd-95a7-b0269b1e501c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:38.780384 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88a8a229-d110-43cd-95a7-b0269b1e501c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:38.780841 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88a8a229-d110-43cd-95a7-b0269b1e501c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:38.781545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88a8a229-d110-43cd-95a7-b0269b1e501c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:38.781992 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88a8a229-d110-43cd-95a7-b0269b1e501c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:38.782434 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88a8a229-d110-43cd-95a7-b0269b1e501c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-88a8a229-d110-43cd-95a7-b0269b1e501c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] HTTP exception thrown: Instance 6a3495c2-c921-4efe-afad-e88277a31c16 could not be found. Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-88a8a229-d110-43cd-95a7-b0269b1e501c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Request method failure captured: Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 HTTP/1.1 Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCRATVSFMwvvIZWe5xQ7_c9wMzq45KN3regMiKZhz9BIvXRzjokJpVP2h6qNC1tqKIQi-iiNodWQB_0pB1eXuMPI55r9OuEq0wInvBnvVmMueTrED7lp4GfwjKMoINP91kJLs6kOCYJV5KJjcHgkuBq-D4R3KJHQcULUqKaTjGb7DUJk Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 44c9832086724954853fc474a2a92747 Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-TestVolumeBootPattern-1464331371 Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:33:38.800914 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:33:38.803028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_44c9832086724954853fc474a2a92747", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/44c9832086724954853fc474a2a92747"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/44c9832086724954853fc474a2a92747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/44c9832086724954853fc474a2a92747"}]}] Aug 26 18:33:38.803028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-TestVolumeBootPattern-1464331371 Aug 26 18:33:38.803028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 44c9832086724954853fc474a2a92747 Aug 26 18:33:38.803028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1464331371 Aug 26 18:33:38.803028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-TestVolumeBootPattern-1464331371-project Aug 26 18:33:38.803028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:33:38.803028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:33:38.803028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: deb80cf02c84476182960a91d69b6da1 Aug 26 18:33:38.803028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-TestVolumeBootPattern-1464331371-project Aug 26 18:33:38.803028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:33:38.803028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance 6a3495c2-c921-4efe-afad-e88277a31c16 could not be found. Aug 26 18:33:38.803028 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': '6a3495c2-c921-4efe-afad-e88277a31c16'} Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a3495c2-c921-4efe-afad-e88277a31c16 could not be found. Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:33:38.803911 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a3495c2-c921-4efe-afad-e88277a31c16 could not be found. Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a3495c2-c921-4efe-afad-e88277a31c16 could not be found. Aug 26 18:33:38.805679 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:33:38.807068 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-88a8a229-d110-43cd-95a7-b0269b1e501c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Returning 404 to user: Instance 6a3495c2-c921-4efe-afad-e88277a31c16 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:33:38.807068 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-88a8a229-d110-43cd-95a7-b0269b1e501c tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16" status: 404 len: 111 microversion: 2.1 time: 0.033059 Aug 26 18:33:38.807068 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 549/1082] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:38 2022] GET /compute/v2.1/servers/6a3495c2-c921-4efe-afad-e88277a31c16 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:33:38.927548 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-618ab7e5-cf79-4ee1-b508-b4bfc6e8fd57 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:38.935871 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-618ab7e5-cf79-4ee1-b508-b4bfc6e8fd57 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1567 microversion: 2.1 time: 0.172601 Aug 26 18:33:38.936457 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 534/1083] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:38 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:39.958170 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-40c774ce-4ede-45ce-883e-18837907e95a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:39.959132 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-40c774ce-4ede-45ce-883e-18837907e95a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:39.963003 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=31 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:33:39.970104 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40c774ce-4ede-45ce-883e-18837907e95a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:39.971008 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40c774ce-4ede-45ce-883e-18837907e95a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:39.971545 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40c774ce-4ede-45ce-883e-18837907e95a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:39.972476 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40c774ce-4ede-45ce-883e-18837907e95a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:39.973192 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40c774ce-4ede-45ce-883e-18837907e95a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:39.973705 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40c774ce-4ede-45ce-883e-18837907e95a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:39.978417 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:33:40.113323 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-40c774ce-4ede-45ce-883e-18837907e95a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:40.122189 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-40c774ce-4ede-45ce-883e-18837907e95a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1567 microversion: 2.1 time: 0.168444 Aug 26 18:33:40.122771 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 550/1084] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:39 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:41.143947 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-781210a6-9396-47ea-9bdb-1befa0eaa6ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:41.144583 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-781210a6-9396-47ea-9bdb-1befa0eaa6ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:41.147132 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:33:41.153827 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-781210a6-9396-47ea-9bdb-1befa0eaa6ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:41.154310 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-781210a6-9396-47ea-9bdb-1befa0eaa6ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:41.154737 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-781210a6-9396-47ea-9bdb-1befa0eaa6ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:41.155453 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-781210a6-9396-47ea-9bdb-1befa0eaa6ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:41.155897 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-781210a6-9396-47ea-9bdb-1befa0eaa6ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:41.156313 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-781210a6-9396-47ea-9bdb-1befa0eaa6ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:41.161989 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:33:41.304823 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-781210a6-9396-47ea-9bdb-1befa0eaa6ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:41.313699 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-781210a6-9396-47ea-9bdb-1befa0eaa6ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1567 microversion: 2.1 time: 0.173768 Aug 26 18:33:41.314587 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 535/1085] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:41 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:41.987298 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5e822a66-3fe2-4932-90b0-aa0c8d70d80b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:41.987915 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5e822a66-3fe2-4932-90b0-aa0c8d70d80b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:41.988928 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-cbaf723d-b3aa-4a76-9cd7-3fa55da36963 req-5c8944be-7a84-48fa-953a-8c583ab1c1cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af8ec60-dd9a-4455-b357-74fa237e37ee", "tag": "e7d8dd42-ffb0-4122-a71f-c660208d6944"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:33:41.994656 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e822a66-3fe2-4932-90b0-aa0c8d70d80b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:41.995423 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e822a66-3fe2-4932-90b0-aa0c8d70d80b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:41.995860 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e822a66-3fe2-4932-90b0-aa0c8d70d80b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:41.996592 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e822a66-3fe2-4932-90b0-aa0c8d70d80b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:41.997041 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e822a66-3fe2-4932-90b0-aa0c8d70d80b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:41.997663 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e822a66-3fe2-4932-90b0-aa0c8d70d80b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:41.998854 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-cbaf723d-b3aa-4a76-9cd7-3fa55da36963 req-5c8944be-7a84-48fa-953a-8c583ab1c1cd service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:41.999634 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-cbaf723d-b3aa-4a76-9cd7-3fa55da36963 req-5c8944be-7a84-48fa-953a-8c583ab1c1cd service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:42.000126 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-cbaf723d-b3aa-4a76-9cd7-3fa55da36963 req-5c8944be-7a84-48fa-953a-8c583ab1c1cd service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:42.012266 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-cbaf723d-b3aa-4a76-9cd7-3fa55da36963 req-5c8944be-7a84-48fa-953a-8c583ab1c1cd service nova] Creating event network-changed:e7d8dd42-ffb0-4122-a71f-c660208d6944 for instance 9af8ec60-dd9a-4455-b357-74fa237e37ee on hv-cinder-85199 Aug 26 18:33:42.017743 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-cbaf723d-b3aa-4a76-9cd7-3fa55da36963 req-5c8944be-7a84-48fa-953a-8c583ab1c1cd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032403 Aug 26 18:33:42.018695 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 536/1086] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:33:42.025415 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5e822a66-3fe2-4932-90b0-aa0c8d70d80b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:33:42.117855 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5e822a66-3fe2-4932-90b0-aa0c8d70d80b tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 204 len: 0 microversion: 2.1 time: 0.134350 Aug 26 18:33:42.121825 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 551/1087] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:33:41 2022] DELETE /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:33:42.128010 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-fc461405-6675-4d98-b557-34c509a9fdb5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:42.128946 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-fc461405-6675-4d98-b557-34c509a9fdb5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:42.135647 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fc461405-6675-4d98-b557-34c509a9fdb5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:42.136202 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fc461405-6675-4d98-b557-34c509a9fdb5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:42.136767 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fc461405-6675-4d98-b557-34c509a9fdb5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:42.137691 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fc461405-6675-4d98-b557-34c509a9fdb5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:42.139178 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fc461405-6675-4d98-b557-34c509a9fdb5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:42.139178 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-fc461405-6675-4d98-b557-34c509a9fdb5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:42.297890 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-fc461405-6675-4d98-b557-34c509a9fdb5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:42.308306 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-fc461405-6675-4d98-b557-34c509a9fdb5 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1580 microversion: 2.1 time: 0.184435 Aug 26 18:33:42.320958 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 537/1088] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:42 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1580 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:42.336255 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-efbad70d-a621-4482-88c6-932e606178ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:42.336919 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-efbad70d-a621-4482-88c6-932e606178ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:42.343030 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efbad70d-a621-4482-88c6-932e606178ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:42.343525 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efbad70d-a621-4482-88c6-932e606178ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:42.343930 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efbad70d-a621-4482-88c6-932e606178ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:42.344640 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efbad70d-a621-4482-88c6-932e606178ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:42.345106 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efbad70d-a621-4482-88c6-932e606178ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:42.345513 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efbad70d-a621-4482-88c6-932e606178ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:42.485829 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-efbad70d-a621-4482-88c6-932e606178ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:42.494600 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-efbad70d-a621-4482-88c6-932e606178ba tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1567 microversion: 2.1 time: 0.162659 Aug 26 18:33:42.495191 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 552/1089] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:42 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:43.328938 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-62b2965f-0c59-4a93-b918-afbd0e71629e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:43.329544 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-62b2965f-0c59-4a93-b918-afbd0e71629e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:43.337498 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-62b2965f-0c59-4a93-b918-afbd0e71629e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:43.337994 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-62b2965f-0c59-4a93-b918-afbd0e71629e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:43.338429 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-62b2965f-0c59-4a93-b918-afbd0e71629e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:43.339177 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-62b2965f-0c59-4a93-b918-afbd0e71629e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:43.339635 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-62b2965f-0c59-4a93-b918-afbd0e71629e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:43.340054 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-62b2965f-0c59-4a93-b918-afbd0e71629e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:43.515581 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b7d189ea-5b7f-407c-a044-7f9de34e9fd0 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:43.516138 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-62b2965f-0c59-4a93-b918-afbd0e71629e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:43.516960 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b7d189ea-5b7f-407c-a044-7f9de34e9fd0 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:43.525212 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7d189ea-5b7f-407c-a044-7f9de34e9fd0 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:43.525495 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-62b2965f-0c59-4a93-b918-afbd0e71629e tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1580 microversion: 2.1 time: 0.200780 Aug 26 18:33:43.525700 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7d189ea-5b7f-407c-a044-7f9de34e9fd0 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:43.526091 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 538/1090] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:43 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1580 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:43.526202 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7d189ea-5b7f-407c-a044-7f9de34e9fd0 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:43.526810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7d189ea-5b7f-407c-a044-7f9de34e9fd0 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:43.527561 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7d189ea-5b7f-407c-a044-7f9de34e9fd0 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:43.527976 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7d189ea-5b7f-407c-a044-7f9de34e9fd0 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:43.666187 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b7d189ea-5b7f-407c-a044-7f9de34e9fd0 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:43.675167 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b7d189ea-5b7f-407c-a044-7f9de34e9fd0 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1567 microversion: 2.1 time: 0.162814 Aug 26 18:33:43.675514 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 553/1091] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:43 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:44.323514 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-56fd96a1-93e9-4f38-8429-d1dde375d3a6 req-a30e0d6d-a61d-48b7-b7d0-4298280dd347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af8ec60-dd9a-4455-b357-74fa237e37ee", "name": "network-vif-deleted", "tag": "e7d8dd42-ffb0-4122-a71f-c660208d6944"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:33:44.333832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-56fd96a1-93e9-4f38-8429-d1dde375d3a6 req-a30e0d6d-a61d-48b7-b7d0-4298280dd347 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:44.334597 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-56fd96a1-93e9-4f38-8429-d1dde375d3a6 req-a30e0d6d-a61d-48b7-b7d0-4298280dd347 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:44.334713 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-56fd96a1-93e9-4f38-8429-d1dde375d3a6 req-a30e0d6d-a61d-48b7-b7d0-4298280dd347 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:44.345942 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-56fd96a1-93e9-4f38-8429-d1dde375d3a6 req-a30e0d6d-a61d-48b7-b7d0-4298280dd347 service nova] Creating event network-vif-deleted:e7d8dd42-ffb0-4122-a71f-c660208d6944 for instance 9af8ec60-dd9a-4455-b357-74fa237e37ee on hv-cinder-85199 Aug 26 18:33:44.351994 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-56fd96a1-93e9-4f38-8429-d1dde375d3a6 req-a30e0d6d-a61d-48b7-b7d0-4298280dd347 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032540 Aug 26 18:33:44.352696 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 539/1092] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:33:44.547725 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ad0b799f-4aa6-42b5-b091-8fb74a1a70cf tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:44.549040 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ad0b799f-4aa6-42b5-b091-8fb74a1a70cf tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:44.555930 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad0b799f-4aa6-42b5-b091-8fb74a1a70cf tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:44.556394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad0b799f-4aa6-42b5-b091-8fb74a1a70cf tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:44.556854 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad0b799f-4aa6-42b5-b091-8fb74a1a70cf tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:44.557557 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad0b799f-4aa6-42b5-b091-8fb74a1a70cf tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:44.558040 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad0b799f-4aa6-42b5-b091-8fb74a1a70cf tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:44.558442 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad0b799f-4aa6-42b5-b091-8fb74a1a70cf tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:44.621977 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ad0b799f-4aa6-42b5-b091-8fb74a1a70cf tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deb80cf02c84476182960a91d69b6da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9832086724954853fc474a2a92747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:44.632264 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ad0b799f-4aa6-42b5-b091-8fb74a1a70cf tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 200 len: 1226 microversion: 2.1 time: 0.088391 Aug 26 18:33:44.632900 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 554/1093] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:44 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:44.696649 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-13aa8623-64bf-49c4-bcf6-56603830d582 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:44.697354 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-13aa8623-64bf-49c4-bcf6-56603830d582 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:44.703585 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-13aa8623-64bf-49c4-bcf6-56603830d582 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:44.704269 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-13aa8623-64bf-49c4-bcf6-56603830d582 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:44.704688 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-13aa8623-64bf-49c4-bcf6-56603830d582 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:44.705663 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-13aa8623-64bf-49c4-bcf6-56603830d582 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:44.706130 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-13aa8623-64bf-49c4-bcf6-56603830d582 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:44.706542 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-13aa8623-64bf-49c4-bcf6-56603830d582 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:44.853629 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-13aa8623-64bf-49c4-bcf6-56603830d582 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:44.861454 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-13aa8623-64bf-49c4-bcf6-56603830d582 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1567 microversion: 2.1 time: 0.169149 Aug 26 18:33:44.862029 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 540/1094] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:44 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:45.656194 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-69622445-1f2e-4cef-8c0c-9ebf61326a72 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:45.657379 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-69622445-1f2e-4cef-8c0c-9ebf61326a72 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 9af8ec60-dd9a-4455-b357-74fa237e37ee] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:45.666079 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69622445-1f2e-4cef-8c0c-9ebf61326a72 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:45.666571 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69622445-1f2e-4cef-8c0c-9ebf61326a72 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:45.667002 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69622445-1f2e-4cef-8c0c-9ebf61326a72 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:45.667718 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69622445-1f2e-4cef-8c0c-9ebf61326a72 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:45.668166 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69622445-1f2e-4cef-8c0c-9ebf61326a72 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:45.668572 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69622445-1f2e-4cef-8c0c-9ebf61326a72 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:45.683451 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-69622445-1f2e-4cef-8c0c-9ebf61326a72 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] HTTP exception thrown: Instance 9af8ec60-dd9a-4455-b357-74fa237e37ee could not be found. Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-69622445-1f2e-4cef-8c0c-9ebf61326a72 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Request method failure captured: Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee HTTP/1.1 Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCRATVSFMwvvIZWe5xQ7_c9wMzq45KN3regMiKZhz9BIvXRzjokJpVP2h6qNC1tqKIQi-iiNodWQB_0pB1eXuMPI55r9OuEq0wInvBnvVmMueTrED7lp4GfwjKMoINP91kJLs6kOCYJV5KJjcHgkuBq-D4R3KJHQcULUqKaTjGb7DUJk Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 44c9832086724954853fc474a2a92747 Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-TestVolumeBootPattern-1464331371 Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:33:45.685164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:33:45.686630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_44c9832086724954853fc474a2a92747", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/44c9832086724954853fc474a2a92747"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/44c9832086724954853fc474a2a92747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/44c9832086724954853fc474a2a92747"}]}] Aug 26 18:33:45.686630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-TestVolumeBootPattern-1464331371 Aug 26 18:33:45.686630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 44c9832086724954853fc474a2a92747 Aug 26 18:33:45.686630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1464331371 Aug 26 18:33:45.686630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-TestVolumeBootPattern-1464331371-project Aug 26 18:33:45.686630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:33:45.686630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:33:45.686630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: deb80cf02c84476182960a91d69b6da1 Aug 26 18:33:45.686630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-TestVolumeBootPattern-1464331371-project Aug 26 18:33:45.686630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:33:45.686630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance 9af8ec60-dd9a-4455-b357-74fa237e37ee could not be found. Aug 26 18:33:45.686630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': '9af8ec60-dd9a-4455-b357-74fa237e37ee'} Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af8ec60-dd9a-4455-b357-74fa237e37ee could not be found. Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:33:45.687574 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af8ec60-dd9a-4455-b357-74fa237e37ee could not be found. Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af8ec60-dd9a-4455-b357-74fa237e37ee could not be found. Aug 26 18:33:45.689083 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:33:45.690824 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-69622445-1f2e-4cef-8c0c-9ebf61326a72 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Returning 404 to user: Instance 9af8ec60-dd9a-4455-b357-74fa237e37ee could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:33:45.690824 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-69622445-1f2e-4cef-8c0c-9ebf61326a72 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee" status: 404 len: 111 microversion: 2.1 time: 0.036392 Aug 26 18:33:45.690824 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 555/1095] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:45 2022] GET /compute/v2.1/servers/9af8ec60-dd9a-4455-b357-74fa237e37ee => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 18:33:45.883284 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-ba1dc9ba-9fbb-40da-b427-bf53eb6d7804 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:45.883994 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-ba1dc9ba-9fbb-40da-b427-bf53eb6d7804 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:45.890787 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ba1dc9ba-9fbb-40da-b427-bf53eb6d7804 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:45.891298 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ba1dc9ba-9fbb-40da-b427-bf53eb6d7804 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:45.891721 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ba1dc9ba-9fbb-40da-b427-bf53eb6d7804 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:45.892410 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ba1dc9ba-9fbb-40da-b427-bf53eb6d7804 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:45.892882 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ba1dc9ba-9fbb-40da-b427-bf53eb6d7804 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:45.893300 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-ba1dc9ba-9fbb-40da-b427-bf53eb6d7804 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:46.030199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-ba1dc9ba-9fbb-40da-b427-bf53eb6d7804 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:46.039722 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-ba1dc9ba-9fbb-40da-b427-bf53eb6d7804 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1567 microversion: 2.1 time: 0.160442 Aug 26 18:33:46.040315 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 541/1096] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:45 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:46.139489 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b99b954d-8a48-482c-bd18-4672f067eed7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:46.140085 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b99b954d-8a48-482c-bd18-4672f067eed7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:46.146330 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b99b954d-8a48-482c-bd18-4672f067eed7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:46.146808 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b99b954d-8a48-482c-bd18-4672f067eed7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:46.147243 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b99b954d-8a48-482c-bd18-4672f067eed7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:46.147937 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b99b954d-8a48-482c-bd18-4672f067eed7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:46.148385 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b99b954d-8a48-482c-bd18-4672f067eed7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:46.148835 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b99b954d-8a48-482c-bd18-4672f067eed7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:46.162865 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-b99b954d-8a48-482c-bd18-4672f067eed7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] HTTP exception thrown: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b99b954d-8a48-482c-bd18-4672f067eed7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Request method failure captured: Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 HTTP/1.1 Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCRATVSFMwvvIZWe5xQ7_c9wMzq45KN3regMiKZhz9BIvXRzjokJpVP2h6qNC1tqKIQi-iiNodWQB_0pB1eXuMPI55r9OuEq0wInvBnvVmMueTrED7lp4GfwjKMoINP91kJLs6kOCYJV5KJjcHgkuBq-D4R3KJHQcULUqKaTjGb7DUJk Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: 44c9832086724954853fc474a2a92747 Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-TestVolumeBootPattern-1464331371 Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:33:46.164507 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:33:46.166200 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_44c9832086724954853fc474a2a92747", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/44c9832086724954853fc474a2a92747"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/44c9832086724954853fc474a2a92747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/44c9832086724954853fc474a2a92747"}]}] Aug 26 18:33:46.166200 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-TestVolumeBootPattern-1464331371 Aug 26 18:33:46.166200 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 44c9832086724954853fc474a2a92747 Aug 26 18:33:46.166200 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1464331371 Aug 26 18:33:46.166200 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-TestVolumeBootPattern-1464331371-project Aug 26 18:33:46.166200 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:33:46.166200 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:33:46.166200 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: deb80cf02c84476182960a91d69b6da1 Aug 26 18:33:46.166200 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-TestVolumeBootPattern-1464331371-project Aug 26 18:33:46.166200 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:33:46.166200 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. Aug 26 18:33:46.166200 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': '570e7fd4-4295-4f3c-9d2a-02f704ea6100'} Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:33:46.167093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. Aug 26 18:33:46.168669 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:33:46.170255 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b99b954d-8a48-482c-bd18-4672f067eed7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Returning 404 to user: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:33:46.170255 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b99b954d-8a48-482c-bd18-4672f067eed7 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "DELETE /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 404 len: 111 microversion: 2.1 time: 0.031337 Aug 26 18:33:46.170255 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 556/1097] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:33:46 2022] DELETE /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:33:46.175351 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c3650bf2-c1c1-4736-8357-5cb77f4c00ed tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:46.175963 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c3650bf2-c1c1-4736-8357-5cb77f4c00ed tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] [instance: 570e7fd4-4295-4f3c-9d2a-02f704ea6100] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:46.182417 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c3650bf2-c1c1-4736-8357-5cb77f4c00ed tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:46.182898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c3650bf2-c1c1-4736-8357-5cb77f4c00ed tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:46.183368 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c3650bf2-c1c1-4736-8357-5cb77f4c00ed tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:46.184072 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c3650bf2-c1c1-4736-8357-5cb77f4c00ed tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:46.184518 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c3650bf2-c1c1-4736-8357-5cb77f4c00ed tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:46.184976 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c3650bf2-c1c1-4736-8357-5cb77f4c00ed tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:46.199960 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-c3650bf2-c1c1-4736-8357-5cb77f4c00ed tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] HTTP exception thrown: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c3650bf2-c1c1-4736-8357-5cb77f4c00ed tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Request method failure captured: Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 HTTP/1.1 Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCRATVSFMwvvIZWe5xQ7_c9wMzq45KN3regMiKZhz9BIvXRzjokJpVP2h6qNC1tqKIQi-iiNodWQB_0pB1eXuMPI55r9OuEq0wInvBnvVmMueTrED7lp4GfwjKMoINP91kJLs6kOCYJV5KJjcHgkuBq-D4R3KJHQcULUqKaTjGb7DUJk Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 44c9832086724954853fc474a2a92747 Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-TestVolumeBootPattern-1464331371 Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:33:46.201832 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:33:46.203524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_44c9832086724954853fc474a2a92747", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/44c9832086724954853fc474a2a92747"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/44c9832086724954853fc474a2a92747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/44c9832086724954853fc474a2a92747"}]}] Aug 26 18:33:46.203524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-TestVolumeBootPattern-1464331371 Aug 26 18:33:46.203524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 44c9832086724954853fc474a2a92747 Aug 26 18:33:46.203524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-TestVolumeBootPattern-1464331371 Aug 26 18:33:46.203524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-TestVolumeBootPattern-1464331371-project Aug 26 18:33:46.203524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:33:46.203524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:33:46.203524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: deb80cf02c84476182960a91d69b6da1 Aug 26 18:33:46.203524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-TestVolumeBootPattern-1464331371-project Aug 26 18:33:46.203524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:33:46.203524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. Aug 26 18:33:46.203524 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '570e7fd4-4295-4f3c-9d2a-02f704ea6100'} Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:33:46.204519 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. Aug 26 18:33:46.206475 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:33:46.208117 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c3650bf2-c1c1-4736-8357-5cb77f4c00ed tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Returning 404 to user: Instance 570e7fd4-4295-4f3c-9d2a-02f704ea6100 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:33:46.208117 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c3650bf2-c1c1-4736-8357-5cb77f4c00ed tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100" status: 404 len: 111 microversion: 2.1 time: 0.032136 Aug 26 18:33:46.208117 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 542/1098] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:46 2022] GET /compute/v2.1/servers/570e7fd4-4295-4f3c-9d2a-02f704ea6100 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:33:47.060709 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-72b8104d-5466-4194-bc30-532d8fc74671 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:47.061354 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-72b8104d-5466-4194-bc30-532d8fc74671 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:47.069405 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72b8104d-5466-4194-bc30-532d8fc74671 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:47.069884 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72b8104d-5466-4194-bc30-532d8fc74671 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:47.070310 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72b8104d-5466-4194-bc30-532d8fc74671 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:47.071038 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72b8104d-5466-4194-bc30-532d8fc74671 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:47.071479 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72b8104d-5466-4194-bc30-532d8fc74671 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:47.071919 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72b8104d-5466-4194-bc30-532d8fc74671 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:47.212162 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-72b8104d-5466-4194-bc30-532d8fc74671 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:47.220244 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-72b8104d-5466-4194-bc30-532d8fc74671 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1567 microversion: 2.1 time: 0.163609 Aug 26 18:33:47.220853 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 557/1099] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:47 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:47.578064 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f4d95812-d65a-4248-9cfd-6aa926877b43 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] Calling method '.version_select at 0x7fc744279940>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:47.600756 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f4d95812-d65a-4248-9cfd-6aa926877b43 tempest-TestVolumeBootPattern-1464331371 tempest-TestVolumeBootPattern-1464331371-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1811114461" status: 202 len: 0 microversion: 2.1 time: 0.026553 Aug 26 18:33:47.603244 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 543/1100] 10.222.0.45 () {58 vars in 1263 bytes} [Fri Aug 26 18:33:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1811114461 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:33:48.245630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-252f9a43-d99e-4b4a-a9eb-4c39ced211be tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:48.248171 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-252f9a43-d99e-4b4a-a9eb-4c39ced211be tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:48.261740 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-252f9a43-d99e-4b4a-a9eb-4c39ced211be tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:48.263164 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-252f9a43-d99e-4b4a-a9eb-4c39ced211be tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:48.264222 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-252f9a43-d99e-4b4a-a9eb-4c39ced211be tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:48.265786 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-252f9a43-d99e-4b4a-a9eb-4c39ced211be tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:48.266919 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-252f9a43-d99e-4b4a-a9eb-4c39ced211be tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:48.268017 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-252f9a43-d99e-4b4a-a9eb-4c39ced211be tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:48.506715 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-252f9a43-d99e-4b4a-a9eb-4c39ced211be tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:48.514962 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-252f9a43-d99e-4b4a-a9eb-4c39ced211be tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1508 microversion: 2.1 time: 0.276350 Aug 26 18:33:48.515738 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 558/1101] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:48 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1508 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:48.538200 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-c0780617-ebfc-4348-9aff-e4d8edd6feb1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:33:48.538795 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c0780617-ebfc-4348-9aff-e4d8edd6feb1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:48.546302 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c0780617-ebfc-4348-9aff-e4d8edd6feb1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:48.546767 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c0780617-ebfc-4348-9aff-e4d8edd6feb1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:48.547205 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c0780617-ebfc-4348-9aff-e4d8edd6feb1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:48.548010 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c0780617-ebfc-4348-9aff-e4d8edd6feb1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:48.548452 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c0780617-ebfc-4348-9aff-e4d8edd6feb1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:48.548899 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-c0780617-ebfc-4348-9aff-e4d8edd6feb1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:48.585044 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-c0780617-ebfc-4348-9aff-e4d8edd6feb1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120540) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 18:33:48.666890 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-c0780617-ebfc-4348-9aff-e4d8edd6feb1 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "POST /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967/action" status: 202 len: 0 microversion: 2.1 time: 0.132811 Aug 26 18:33:48.667784 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 544/1102] 10.222.0.45 () {60 vars in 1278 bytes} [Fri Aug 26 18:33:48 2022] POST /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:33:48.682973 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-57359665-4743-49f6-907a-4cde03b36723 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:48.683954 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-57359665-4743-49f6-907a-4cde03b36723 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:48.693380 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-57359665-4743-49f6-907a-4cde03b36723 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:48.694326 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-57359665-4743-49f6-907a-4cde03b36723 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:48.698002 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-57359665-4743-49f6-907a-4cde03b36723 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:48.698991 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-57359665-4743-49f6-907a-4cde03b36723 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:48.699467 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-57359665-4743-49f6-907a-4cde03b36723 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:48.699902 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-57359665-4743-49f6-907a-4cde03b36723 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:48.988122 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-57359665-4743-49f6-907a-4cde03b36723 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:49.016544 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-57359665-4743-49f6-907a-4cde03b36723 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1516 microversion: 2.1 time: 0.342124 Aug 26 18:33:49.018038 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 559/1103] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:48 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1516 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:50.043575 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-3b392814-83b8-4173-a493-85a3bc5a42dc tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:50.045000 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-3b392814-83b8-4173-a493-85a3bc5a42dc tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:50.053252 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3b392814-83b8-4173-a493-85a3bc5a42dc tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:50.054079 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3b392814-83b8-4173-a493-85a3bc5a42dc tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:50.054715 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3b392814-83b8-4173-a493-85a3bc5a42dc tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:50.055633 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3b392814-83b8-4173-a493-85a3bc5a42dc tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:50.056434 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3b392814-83b8-4173-a493-85a3bc5a42dc tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:50.057070 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3b392814-83b8-4173-a493-85a3bc5a42dc tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:50.206951 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3b392814-83b8-4173-a493-85a3bc5a42dc tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:50.216176 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-3b392814-83b8-4173-a493-85a3bc5a42dc tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1518 microversion: 2.1 time: 0.177631 Aug 26 18:33:50.233316 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 545/1104] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:50 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1518 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:51.241513 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9d217f5f-e958-4166-8d91-a31a53b5f877 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:51.242169 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9d217f5f-e958-4166-8d91-a31a53b5f877 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:51.249953 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d217f5f-e958-4166-8d91-a31a53b5f877 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:51.250486 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d217f5f-e958-4166-8d91-a31a53b5f877 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:51.251006 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d217f5f-e958-4166-8d91-a31a53b5f877 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:51.251872 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d217f5f-e958-4166-8d91-a31a53b5f877 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:51.252318 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d217f5f-e958-4166-8d91-a31a53b5f877 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:51.252785 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d217f5f-e958-4166-8d91-a31a53b5f877 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:51.467039 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9d217f5f-e958-4166-8d91-a31a53b5f877 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:51.491382 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9d217f5f-e958-4166-8d91-a31a53b5f877 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1574 microversion: 2.1 time: 0.254041 Aug 26 18:33:51.493118 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 560/1105] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:51 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1574 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:51.870582 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-834b8dff-52d1-4dcc-b84e-424f911718c9 req-1aef6e9c-c868-4f4d-926a-85836ff51bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a74e4cb-8108-4101-8dbe-c063481f2967", "name": "network-vif-unplugged", "status": "completed", "tag": "9b7f8fc1-6d04-4211-ab6a-e06a963d8464"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:33:51.884151 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-834b8dff-52d1-4dcc-b84e-424f911718c9 req-1aef6e9c-c868-4f4d-926a-85836ff51bc8 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:51.885025 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-834b8dff-52d1-4dcc-b84e-424f911718c9 req-1aef6e9c-c868-4f4d-926a-85836ff51bc8 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:51.885457 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-834b8dff-52d1-4dcc-b84e-424f911718c9 req-1aef6e9c-c868-4f4d-926a-85836ff51bc8 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:51.906283 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-834b8dff-52d1-4dcc-b84e-424f911718c9 req-1aef6e9c-c868-4f4d-926a-85836ff51bc8 service nova] Creating event network-vif-unplugged:9b7f8fc1-6d04-4211-ab6a-e06a963d8464 for instance 8a74e4cb-8108-4101-8dbe-c063481f2967 on hv-cinder-85199 Aug 26 18:33:51.916443 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-834b8dff-52d1-4dcc-b84e-424f911718c9 req-1aef6e9c-c868-4f4d-926a-85836ff51bc8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054295 Aug 26 18:33:51.917371 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 546/1106] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:33:52.525215 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-193b4065-6825-4562-8266-6f1c814636fb tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:52.525836 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-193b4065-6825-4562-8266-6f1c814636fb tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:52.533328 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-193b4065-6825-4562-8266-6f1c814636fb tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:52.533831 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-193b4065-6825-4562-8266-6f1c814636fb tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:52.534264 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-193b4065-6825-4562-8266-6f1c814636fb tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:52.534988 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-193b4065-6825-4562-8266-6f1c814636fb tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:52.535446 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-193b4065-6825-4562-8266-6f1c814636fb tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:52.535878 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-193b4065-6825-4562-8266-6f1c814636fb tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:52.696239 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-193b4065-6825-4562-8266-6f1c814636fb tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:52.714732 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-193b4065-6825-4562-8266-6f1c814636fb tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1574 microversion: 2.1 time: 0.193836 Aug 26 18:33:52.715411 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 561/1107] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:52 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1574 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:53.738596 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-23aac7e5-db45-4150-b648-a2550af1339c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:53.740119 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-23aac7e5-db45-4150-b648-a2550af1339c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:53.747819 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23aac7e5-db45-4150-b648-a2550af1339c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:53.748462 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23aac7e5-db45-4150-b648-a2550af1339c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:53.749015 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23aac7e5-db45-4150-b648-a2550af1339c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:53.749874 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23aac7e5-db45-4150-b648-a2550af1339c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:53.752398 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23aac7e5-db45-4150-b648-a2550af1339c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:53.753116 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-23aac7e5-db45-4150-b648-a2550af1339c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:53.974658 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-23aac7e5-db45-4150-b648-a2550af1339c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:53.983325 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-23aac7e5-db45-4150-b648-a2550af1339c tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1574 microversion: 2.1 time: 0.250130 Aug 26 18:33:53.984107 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 547/1108] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:53 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1574 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:55.007138 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2142c737-ea2b-4f17-987b-6b09f733d82a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:55.007698 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2142c737-ea2b-4f17-987b-6b09f733d82a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:55.017608 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2142c737-ea2b-4f17-987b-6b09f733d82a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:55.018389 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2142c737-ea2b-4f17-987b-6b09f733d82a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:55.019093 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2142c737-ea2b-4f17-987b-6b09f733d82a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:55.020063 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2142c737-ea2b-4f17-987b-6b09f733d82a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:55.020864 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2142c737-ea2b-4f17-987b-6b09f733d82a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:55.021548 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2142c737-ea2b-4f17-987b-6b09f733d82a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:55.221862 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2142c737-ea2b-4f17-987b-6b09f733d82a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:55.231941 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2142c737-ea2b-4f17-987b-6b09f733d82a tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1574 microversion: 2.1 time: 0.230376 Aug 26 18:33:55.232692 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 562/1109] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:55 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1574 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:56.254360 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e43bb953-47c6-4b9f-93ea-6c009656a476 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:56.255090 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e43bb953-47c6-4b9f-93ea-6c009656a476 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:56.262870 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e43bb953-47c6-4b9f-93ea-6c009656a476 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:56.263368 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e43bb953-47c6-4b9f-93ea-6c009656a476 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:56.263804 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e43bb953-47c6-4b9f-93ea-6c009656a476 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:56.264509 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e43bb953-47c6-4b9f-93ea-6c009656a476 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:56.264984 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e43bb953-47c6-4b9f-93ea-6c009656a476 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:56.265630 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e43bb953-47c6-4b9f-93ea-6c009656a476 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:56.452194 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e43bb953-47c6-4b9f-93ea-6c009656a476 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:56.461521 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e43bb953-47c6-4b9f-93ea-6c009656a476 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1574 microversion: 2.1 time: 0.211018 Aug 26 18:33:56.462156 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 548/1110] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:56 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1574 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:57.483635 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2e9c6260-413f-4a59-bcab-25f612b6c02b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:57.485181 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2e9c6260-413f-4a59-bcab-25f612b6c02b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:57.492935 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e9c6260-413f-4a59-bcab-25f612b6c02b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:57.493423 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e9c6260-413f-4a59-bcab-25f612b6c02b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:57.493846 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e9c6260-413f-4a59-bcab-25f612b6c02b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:57.494653 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e9c6260-413f-4a59-bcab-25f612b6c02b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:57.495118 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e9c6260-413f-4a59-bcab-25f612b6c02b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:57.495560 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e9c6260-413f-4a59-bcab-25f612b6c02b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:57.645134 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2e9c6260-413f-4a59-bcab-25f612b6c02b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:57.655193 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2e9c6260-413f-4a59-bcab-25f612b6c02b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1574 microversion: 2.1 time: 0.175435 Aug 26 18:33:57.655777 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 563/1111] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:57 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:58.677710 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e06bf605-c26d-4128-b4a5-3453009f9afa tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:58.678478 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e06bf605-c26d-4128-b4a5-3453009f9afa tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:58.685728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e06bf605-c26d-4128-b4a5-3453009f9afa tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:58.686220 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e06bf605-c26d-4128-b4a5-3453009f9afa tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:58.686644 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e06bf605-c26d-4128-b4a5-3453009f9afa tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:58.687353 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e06bf605-c26d-4128-b4a5-3453009f9afa tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:58.687790 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e06bf605-c26d-4128-b4a5-3453009f9afa tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:58.688199 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e06bf605-c26d-4128-b4a5-3453009f9afa tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:58.827228 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-e06bf605-c26d-4128-b4a5-3453009f9afa tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:33:58.835031 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e06bf605-c26d-4128-b4a5-3453009f9afa tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1574 microversion: 2.1 time: 0.162223 Aug 26 18:33:58.835591 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 549/1112] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:58 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:33:59.856912 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e5a50cdb-dc0d-4439-b97b-6f86f8698559 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:33:59.857497 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e5a50cdb-dc0d-4439-b97b-6f86f8698559 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:33:59.864171 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5a50cdb-dc0d-4439-b97b-6f86f8698559 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:59.864660 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5a50cdb-dc0d-4439-b97b-6f86f8698559 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:59.865127 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5a50cdb-dc0d-4439-b97b-6f86f8698559 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:33:59.865834 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5a50cdb-dc0d-4439-b97b-6f86f8698559 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:33:59.866283 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5a50cdb-dc0d-4439-b97b-6f86f8698559 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:33:59.866708 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5a50cdb-dc0d-4439-b97b-6f86f8698559 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:00.014180 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e5a50cdb-dc0d-4439-b97b-6f86f8698559 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:34:00.023368 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e5a50cdb-dc0d-4439-b97b-6f86f8698559 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1561 microversion: 2.1 time: 0.170322 Aug 26 18:34:00.023986 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 564/1113] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:33:59 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:34:00.544374 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-de1555ec-16fa-488c-ab15-e3618eb3f397 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1863540207"}} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:34:00.545511 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-de1555ec-16fa-488c-ab15-e3618eb3f397 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:34:00.556686 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de1555ec-16fa-488c-ab15-e3618eb3f397 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:00.557596 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de1555ec-16fa-488c-ab15-e3618eb3f397 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:00.558329 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de1555ec-16fa-488c-ab15-e3618eb3f397 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:00.559466 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de1555ec-16fa-488c-ab15-e3618eb3f397 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:00.560236 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de1555ec-16fa-488c-ab15-e3618eb3f397 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:00.561015 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-de1555ec-16fa-488c-ab15-e3618eb3f397 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:00.722047 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.network.security_group_api [None req-de1555ec-16fa-488c-ab15-e3618eb3f397 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Removing security group 0a7baf8a-dc61-4e71-b7a5-0e9be19f39bc from port 78fb9d16-e9c7-48e4-b391-d84d7b05ae6e Aug 26 18:34:01.043362 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-de1555ec-16fa-488c-ab15-e3618eb3f397 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "POST /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/action" status: 202 len: 0 microversion: 2.1 time: 0.505844 Aug 26 18:34:01.044510 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 550/1114] 10.222.0.45 () {60 vars in 1278 bytes} [Fri Aug 26 18:34:00 2022] POST /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:34:01.324232 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-e7201832-f2c5-4a32-9a54-f27e3baa22d7 req-2f878420-e47c-41a6-959a-29a694b27bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f0f651-94dd-4845-b0b7-3fc15bc5c2a2", "tag": "78fb9d16-e9c7-48e4-b391-d84d7b05ae6e"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:34:01.336460 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e7201832-f2c5-4a32-9a54-f27e3baa22d7 req-2f878420-e47c-41a6-959a-29a694b27bff service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:01.337054 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e7201832-f2c5-4a32-9a54-f27e3baa22d7 req-2f878420-e47c-41a6-959a-29a694b27bff service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:01.337489 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e7201832-f2c5-4a32-9a54-f27e3baa22d7 req-2f878420-e47c-41a6-959a-29a694b27bff service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:01.349404 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-e7201832-f2c5-4a32-9a54-f27e3baa22d7 req-2f878420-e47c-41a6-959a-29a694b27bff service nova] Creating event network-changed:78fb9d16-e9c7-48e4-b391-d84d7b05ae6e for instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 on hv-cinder-85199 Aug 26 18:34:01.356463 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-e7201832-f2c5-4a32-9a54-f27e3baa22d7 req-2f878420-e47c-41a6-959a-29a694b27bff service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.316775 Aug 26 18:34:01.357786 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 565/1115] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:34:01.973011 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-dce66aa6-cdcc-431e-8aa5-12482eaf6b7c req-e761a7ac-4570-4ac6-9692-65245747b459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a74e4cb-8108-4101-8dbe-c063481f2967", "name": "network-vif-plugged", "status": "completed", "tag": "9b7f8fc1-6d04-4211-ab6a-e06a963d8464"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:34:01.988506 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-dce66aa6-cdcc-431e-8aa5-12482eaf6b7c req-e761a7ac-4570-4ac6-9692-65245747b459 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:01.989012 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-dce66aa6-cdcc-431e-8aa5-12482eaf6b7c req-e761a7ac-4570-4ac6-9692-65245747b459 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:01.989456 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-dce66aa6-cdcc-431e-8aa5-12482eaf6b7c req-e761a7ac-4570-4ac6-9692-65245747b459 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:02.002893 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-dce66aa6-cdcc-431e-8aa5-12482eaf6b7c req-e761a7ac-4570-4ac6-9692-65245747b459 service nova] Creating event network-vif-plugged:9b7f8fc1-6d04-4211-ab6a-e06a963d8464 for instance 8a74e4cb-8108-4101-8dbe-c063481f2967 on hv-cinder-85199 Aug 26 18:34:02.009667 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-dce66aa6-cdcc-431e-8aa5-12482eaf6b7c req-e761a7ac-4570-4ac6-9692-65245747b459 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042070 Aug 26 18:34:02.010266 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 551/1116] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:34:02.795417 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c8096d63-7915-4763-a8ed-b27403352539 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:34:02.796012 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c8096d63-7915-4763-a8ed-b27403352539 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:34:02.802965 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8096d63-7915-4763-a8ed-b27403352539 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:02.803459 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8096d63-7915-4763-a8ed-b27403352539 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:02.803889 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8096d63-7915-4763-a8ed-b27403352539 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:02.804611 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8096d63-7915-4763-a8ed-b27403352539 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:02.805099 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8096d63-7915-4763-a8ed-b27403352539 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:02.805525 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8096d63-7915-4763-a8ed-b27403352539 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:02.890376 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-c8096d63-7915-4763-a8ed-b27403352539 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lazy-loading 'services' on Instance uuid 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:34:02.892735 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:34:02.972516 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c8096d63-7915-4763-a8ed-b27403352539 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "DELETE /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/os-volume_attachments/ea6d5839-4282-43c5-a535-66204ca07b91" status: 202 len: 0 microversion: 2.1 time: 0.181974 Aug 26 18:34:02.973161 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 566/1117] 10.222.0.45 () {58 vars in 1416 bytes} [Fri Aug 26 18:34:02 2022] DELETE /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/os-volume_attachments/ea6d5839-4282-43c5-a535-66204ca07b91 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:34:02.982388 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-17977eb3-ab34-465f-8776-d974c73ebe80 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:34:02.984964 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-17977eb3-ab34-465f-8776-d974c73ebe80 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:34:02.991640 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-17977eb3-ab34-465f-8776-d974c73ebe80 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:02.992293 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-17977eb3-ab34-465f-8776-d974c73ebe80 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:02.992804 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-17977eb3-ab34-465f-8776-d974c73ebe80 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:02.993587 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-17977eb3-ab34-465f-8776-d974c73ebe80 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:02.994098 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-17977eb3-ab34-465f-8776-d974c73ebe80 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:02.994578 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-17977eb3-ab34-465f-8776-d974c73ebe80 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:03.030227 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-17977eb3-ab34-465f-8776-d974c73ebe80 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051828 Aug 26 18:34:03.031050 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 552/1118] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:34:02 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:34:03.374414 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-ff57e317-ffc3-4c18-a702-00b0e7129fe0 req-aceb3161-bece-41a2-8d96-fce5d9b61c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f0f651-94dd-4845-b0b7-3fc15bc5c2a2", "tag": "78fb9d16-e9c7-48e4-b391-d84d7b05ae6e"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:34:03.381459 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 18:34:03.381692 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Fri Aug 26 18:34:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.45) !!! Aug 26 18:34:03.390201 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ff57e317-ffc3-4c18-a702-00b0e7129fe0 req-aceb3161-bece-41a2-8d96-fce5d9b61c51 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:03.390665 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ff57e317-ffc3-4c18-a702-00b0e7129fe0 req-aceb3161-bece-41a2-8d96-fce5d9b61c51 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:03.391798 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ff57e317-ffc3-4c18-a702-00b0e7129fe0 req-aceb3161-bece-41a2-8d96-fce5d9b61c51 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:03.406229 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-ff57e317-ffc3-4c18-a702-00b0e7129fe0 req-aceb3161-bece-41a2-8d96-fce5d9b61c51 service nova] Creating event network-changed:78fb9d16-e9c7-48e4-b391-d84d7b05ae6e for instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 on hv-cinder-85199 Aug 26 18:34:03.412159 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-ff57e317-ffc3-4c18-a702-00b0e7129fe0 req-aceb3161-bece-41a2-8d96-fce5d9b61c51 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042397 Aug 26 18:34:03.412793 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 567/1119] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:34:04.046749 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-aea959cd-adcc-41a0-a968-0b09c50fb760 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:34:04.049791 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-aea959cd-adcc-41a0-a968-0b09c50fb760 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:34:04.059260 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aea959cd-adcc-41a0-a968-0b09c50fb760 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:04.059906 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aea959cd-adcc-41a0-a968-0b09c50fb760 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:04.060496 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aea959cd-adcc-41a0-a968-0b09c50fb760 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:04.061555 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aea959cd-adcc-41a0-a968-0b09c50fb760 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:04.062126 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aea959cd-adcc-41a0-a968-0b09c50fb760 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:04.062659 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-aea959cd-adcc-41a0-a968-0b09c50fb760 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:04.091844 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-aea959cd-adcc-41a0-a968-0b09c50fb760 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051301 Aug 26 18:34:04.092413 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 553/1120] 10.222.0.45 () {58 vars in 1302 bytes} [Fri Aug 26 18:34:04 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 18:34:04.107942 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fb167338-342c-4e4c-970e-b7f940c763ef tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:34:04.108489 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fb167338-342c-4e4c-970e-b7f940c763ef tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:34:04.115184 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb167338-342c-4e4c-970e-b7f940c763ef tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:04.115660 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb167338-342c-4e4c-970e-b7f940c763ef tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:04.116061 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb167338-342c-4e4c-970e-b7f940c763ef tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:04.116763 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb167338-342c-4e4c-970e-b7f940c763ef tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:04.117234 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb167338-342c-4e4c-970e-b7f940c763ef tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:04.117647 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb167338-342c-4e4c-970e-b7f940c763ef tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:04.196630 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-fb167338-342c-4e4c-970e-b7f940c763ef tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] HTTP exception thrown: Instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 is not attached to volume ea6d5839-4282-43c5-a535-66204ca07b91 Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fb167338-342c-4e4c-970e-b7f940c763ef tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Request method failure captured: Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/os-volume_attachments/ea6d5839-4282-43c5-a535-66204ca07b91 HTTP/1.1 Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCRGexllBzqDzJsX7EvZlg0tjiUCahv5YcQDCew5JiTj7krH8L8jp44jftrD--gGXgBRIj-VvDMhrm374V3jEeKJFt4Ia0IvR4BnVk5sgahNcsqD4Cx2xxAyMzosL65k_X_3I_ONhYdtQXpmL25HFTVvTSWcW3fSVj6jbB1Q8AhdKEdY Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: c26abe1c65a24c8796880a82af3627e0 Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-TestMinimumBasicScenario-1508019538 Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:34:04.198972 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:34:04.200764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c26abe1c65a24c8796880a82af3627e0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c26abe1c65a24c8796880a82af3627e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c26abe1c65a24c8796880a82af3627e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c26abe1c65a24c8796880a82af3627e0"}]}] Aug 26 18:34:04.200764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-TestMinimumBasicScenario-1508019538 Aug 26 18:34:04.200764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: c26abe1c65a24c8796880a82af3627e0 Aug 26 18:34:04.200764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1508019538 Aug 26 18:34:04.200764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-TestMinimumBasicScenario-1508019538-project Aug 26 18:34:04.200764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:34:04.200764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:34:04.200764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: 6fc89be7205648b889aeaa6b072d641b Aug 26 18:34:04.200764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-TestMinimumBasicScenario-1508019538-project Aug 26 18:34:04.200764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:34:04.200764 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 is not attached to volume ea6d5839-4282-43c5-a535-66204ca07b91 Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'server_id': '20f0f651-94dd-4845-b0b7-3fc15bc5c2a2', 'id': 'ea6d5839-4282-43c5-a535-66204ca07b91'} Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ea6d5839-4282-43c5-a535-66204ca07b91. Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:34:04.202020 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:34:04.203924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:34:04.203924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 26 18:34:04.203924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 26 18:34:04.203924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 is not attached to volume ea6d5839-4282-43c5-a535-66204ca07b91 Aug 26 18:34:04.203924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:34:04.203924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:34:04.203924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:34:04.203924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:34:04.203924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:34:04.203924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:34:04.203924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:34:04.203924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:34:04.203924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 is not attached to volume ea6d5839-4282-43c5-a535-66204ca07b91 Aug 26 18:34:04.203924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:34:04.203924 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fb167338-342c-4e4c-970e-b7f940c763ef tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Returning 404 to user: Instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 is not attached to volume ea6d5839-4282-43c5-a535-66204ca07b91 {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:34:04.205063 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fb167338-342c-4e4c-970e-b7f940c763ef tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "DELETE /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/os-volume_attachments/ea6d5839-4282-43c5-a535-66204ca07b91" status: 404 len: 154 microversion: 2.1 time: 0.097378 Aug 26 18:34:04.205063 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 568/1121] 10.222.0.45 () {58 vars in 1416 bytes} [Fri Aug 26 18:34:04 2022] DELETE /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2/os-volume_attachments/ea6d5839-4282-43c5-a535-66204ca07b91 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:34:05.358438 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-76845b27-e195-4358-bbb1-97817d3abc34 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:34:05.359031 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-76845b27-e195-4358-bbb1-97817d3abc34 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:34:05.365493 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-76845b27-e195-4358-bbb1-97817d3abc34 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:05.365966 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-76845b27-e195-4358-bbb1-97817d3abc34 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:05.366385 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-76845b27-e195-4358-bbb1-97817d3abc34 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:05.367069 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-76845b27-e195-4358-bbb1-97817d3abc34 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:05.367509 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-76845b27-e195-4358-bbb1-97817d3abc34 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:05.367923 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-76845b27-e195-4358-bbb1-97817d3abc34 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:05.392084 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-76845b27-e195-4358-bbb1-97817d3abc34 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Going to try to terminate instance {{(pid=120540) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:34:05.415590 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:34:05.489736 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-76845b27-e195-4358-bbb1-97817d3abc34 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "DELETE /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 204 len: 0 microversion: 2.1 time: 0.134028 Aug 26 18:34:05.491361 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 554/1122] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:34:05 2022] DELETE /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:34:05.502778 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eb9e1a19-c479-4a4f-b3b0-67cae25e14e0 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:34:05.503614 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eb9e1a19-c479-4a4f-b3b0-67cae25e14e0 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:34:05.511179 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb9e1a19-c479-4a4f-b3b0-67cae25e14e0 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:05.511656 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb9e1a19-c479-4a4f-b3b0-67cae25e14e0 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:05.512095 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb9e1a19-c479-4a4f-b3b0-67cae25e14e0 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:05.512822 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb9e1a19-c479-4a4f-b3b0-67cae25e14e0 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:05.513271 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb9e1a19-c479-4a4f-b3b0-67cae25e14e0 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:05.513729 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb9e1a19-c479-4a4f-b3b0-67cae25e14e0 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:05.670852 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eb9e1a19-c479-4a4f-b3b0-67cae25e14e0 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:34:05.679051 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eb9e1a19-c479-4a4f-b3b0-67cae25e14e0 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1554 microversion: 2.1 time: 0.180483 Aug 26 18:34:05.679611 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 569/1123] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:34:05 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:34:06.705018 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-4b01050e-c608-44e4-9b65-51746d2718bc tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:34:06.706164 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-4b01050e-c608-44e4-9b65-51746d2718bc tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:34:06.717123 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b01050e-c608-44e4-9b65-51746d2718bc tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:06.717906 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b01050e-c608-44e4-9b65-51746d2718bc tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:06.718622 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b01050e-c608-44e4-9b65-51746d2718bc tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:06.719787 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b01050e-c608-44e4-9b65-51746d2718bc tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:06.720548 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b01050e-c608-44e4-9b65-51746d2718bc tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:06.721249 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-4b01050e-c608-44e4-9b65-51746d2718bc tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:06.954977 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-4b01050e-c608-44e4-9b65-51746d2718bc tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:34:06.962626 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-4b01050e-c608-44e4-9b65-51746d2718bc tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1554 microversion: 2.1 time: 0.264956 Aug 26 18:34:06.963186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 555/1124] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:34:06 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1554 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:34:07.627217 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-bdd30406-d51a-4ad3-9c95-88d5581fb5d0 req-c8a8055c-2219-4ddd-b964-39b5ad7b221d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f0f651-94dd-4845-b0b7-3fc15bc5c2a2", "name": "network-vif-deleted", "tag": "78fb9d16-e9c7-48e4-b391-d84d7b05ae6e"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:34:07.638350 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-bdd30406-d51a-4ad3-9c95-88d5581fb5d0 req-c8a8055c-2219-4ddd-b964-39b5ad7b221d service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:07.639105 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-bdd30406-d51a-4ad3-9c95-88d5581fb5d0 req-c8a8055c-2219-4ddd-b964-39b5ad7b221d service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:07.639557 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-bdd30406-d51a-4ad3-9c95-88d5581fb5d0 req-c8a8055c-2219-4ddd-b964-39b5ad7b221d service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:07.651586 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-bdd30406-d51a-4ad3-9c95-88d5581fb5d0 req-c8a8055c-2219-4ddd-b964-39b5ad7b221d service nova] Creating event network-vif-deleted:78fb9d16-e9c7-48e4-b391-d84d7b05ae6e for instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 on hv-cinder-85199 Aug 26 18:34:07.656301 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-bdd30406-d51a-4ad3-9c95-88d5581fb5d0 req-c8a8055c-2219-4ddd-b964-39b5ad7b221d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033155 Aug 26 18:34:07.656927 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 570/1125] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:34:07.986605 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-3a29e708-99a4-499c-9bf0-e4dfb9a6a360 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:34:07.987291 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-3a29e708-99a4-499c-9bf0-e4dfb9a6a360 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:34:07.994310 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a29e708-99a4-499c-9bf0-e4dfb9a6a360 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:07.994801 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a29e708-99a4-499c-9bf0-e4dfb9a6a360 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:07.995208 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a29e708-99a4-499c-9bf0-e4dfb9a6a360 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:07.996008 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a29e708-99a4-499c-9bf0-e4dfb9a6a360 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:07.996455 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a29e708-99a4-499c-9bf0-e4dfb9a6a360 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:07.996937 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a29e708-99a4-499c-9bf0-e4dfb9a6a360 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:08.030432 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a29e708-99a4-499c-9bf0-e4dfb9a6a360 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:08.030877 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a29e708-99a4-499c-9bf0-e4dfb9a6a360 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:08.031439 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-3a29e708-99a4-499c-9bf0-e4dfb9a6a360 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:08.031889 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.objects.instance [None req-3a29e708-99a4-499c-9bf0-e4dfb9a6a360 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lazy-loading 'fault' on Instance uuid 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 {{(pid=120540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 18:34:08.075010 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-3a29e708-99a4-499c-9bf0-e4dfb9a6a360 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc89be7205648b889aeaa6b072d641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26abe1c65a24c8796880a82af3627e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:34:08.084128 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-3a29e708-99a4-499c-9bf0-e4dfb9a6a360 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 200 len: 1348 microversion: 2.1 time: 0.101420 Aug 26 18:34:08.084806 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 556/1126] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:34:07 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:34:09.107781 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-41be9c82-cfa3-487c-a401-ba56a027cd88 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:34:09.108429 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-41be9c82-cfa3-487c-a401-ba56a027cd88 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] [instance: 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:34:09.115810 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41be9c82-cfa3-487c-a401-ba56a027cd88 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:09.116292 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41be9c82-cfa3-487c-a401-ba56a027cd88 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:09.116751 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41be9c82-cfa3-487c-a401-ba56a027cd88 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:09.117486 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41be9c82-cfa3-487c-a401-ba56a027cd88 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:34:09.117938 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41be9c82-cfa3-487c-a401-ba56a027cd88 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:34:09.118363 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41be9c82-cfa3-487c-a401-ba56a027cd88 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:34:09.133592 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-41be9c82-cfa3-487c-a401-ba56a027cd88 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] HTTP exception thrown: Instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 could not be found. Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-41be9c82-cfa3-487c-a401-ba56a027cd88 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Request method failure captured: Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 HTTP/1.1 Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Connection: close Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Host: 10.222.0.45 Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABjCRGexllBzqDzJsX7EvZlg0tjiUCahv5YcQDCew5JiTj7krH8L8jp44jftrD--gGXgBRIj-VvDMhrm374V3jEeKJFt4Ia0IvR4BnVk5sgahNcsqD4Cx2xxAyMzosL65k_X_3I_ONhYdtQXpmL25HFTVvTSWcW3fSVj6jbB1Q8AhdKEdY Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Id: c26abe1c65a24c8796880a82af3627e0 Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-TestMinimumBasicScenario-1508019538 Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 26 18:34:09.135394 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 26 18:34:09.137029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c26abe1c65a24c8796880a82af3627e0", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c26abe1c65a24c8796880a82af3627e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c26abe1c65a24c8796880a82af3627e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c26abe1c65a24c8796880a82af3627e0"}]}] Aug 26 18:34:09.137029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-TestMinimumBasicScenario-1508019538 Aug 26 18:34:09.137029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Id: c26abe1c65a24c8796880a82af3627e0 Aug 26 18:34:09.137029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1508019538 Aug 26 18:34:09.137029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User: tempest-TestMinimumBasicScenario-1508019538-project Aug 26 18:34:09.137029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 26 18:34:09.137029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 26 18:34:09.137029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Id: 6fc89be7205648b889aeaa6b072d641b Aug 26 18:34:09.137029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-TestMinimumBasicScenario-1508019538-project Aug 26 18:34:09.137029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: method: > Aug 26 18:34:09.137029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: exception: Instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 could not be found. Aug 26 18:34:09.137029 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: action_args: {'id': '20f0f651-94dd-4845-b0b7-3fc15bc5c2a2'} Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 could not be found. Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:34:09.137963 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 could not be found. Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 could not be found. Aug 26 18:34:09.139465 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 26 18:34:09.140934 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-41be9c82-cfa3-487c-a401-ba56a027cd88 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Returning 404 to user: Instance 20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:34:09.140934 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-41be9c82-cfa3-487c-a401-ba56a027cd88 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2" status: 404 len: 111 microversion: 2.1 time: 0.034502 Aug 26 18:34:09.140934 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 571/1127] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:34:09 2022] GET /compute/v2.1/servers/20f0f651-94dd-4845-b0b7-3fc15bc5c2a2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:34:09.146227 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-f6b544d6-762c-438d-a2f9-eea867275ea3 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] Calling method '.version_select at 0x7fc744075670>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:34:09.168488 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-f6b544d6-762c-438d-a2f9-eea867275ea3 tempest-TestMinimumBasicScenario-1508019538 tempest-TestMinimumBasicScenario-1508019538-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-527312819" status: 202 len: 0 microversion: 2.1 time: 0.026425 Aug 26 18:34:09.169109 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 557/1128] 10.222.0.45 () {58 vars in 1269 bytes} [Fri Aug 26 18:34:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-527312819 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 18:35:14.510664 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:35:14.512038 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG dbcounter [-] [120540] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=120540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:35:14.515039 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a92e95ee-0239-4ceb-9f3d-65f4b3e3ca3e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:35:14.516268 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a92e95ee-0239-4ceb-9f3d-65f4b3e3ca3e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:35:14.529642 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:35:14.531345 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 18:35:14.536269 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a92e95ee-0239-4ceb-9f3d-65f4b3e3ca3e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:35:14.537404 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a92e95ee-0239-4ceb-9f3d-65f4b3e3ca3e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:35:14.538449 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a92e95ee-0239-4ceb-9f3d-65f4b3e3ca3e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:35:14.539879 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a92e95ee-0239-4ceb-9f3d-65f4b3e3ca3e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:35:14.540460 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a92e95ee-0239-4ceb-9f3d-65f4b3e3ca3e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:35:14.541030 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a92e95ee-0239-4ceb-9f3d-65f4b3e3ca3e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:35:14.573528 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a92e95ee-0239-4ceb-9f3d-65f4b3e3ca3e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 18:35:14.698621 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a92e95ee-0239-4ceb-9f3d-65f4b3e3ca3e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 204 len: 0 microversion: 2.1 time: 0.190868 Aug 26 18:35:14.699718 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 572/1129] 10.222.0.45 () {58 vars in 1239 bytes} [Fri Aug 26 18:35:14 2022] DELETE /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 18:35:14.715620 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cc22f415-de3d-4a33-b2d7-0178e96f450e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:35:14.716877 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cc22f415-de3d-4a33-b2d7-0178e96f450e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:35:14.728122 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc22f415-de3d-4a33-b2d7-0178e96f450e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:35:14.729213 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc22f415-de3d-4a33-b2d7-0178e96f450e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:35:14.730120 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc22f415-de3d-4a33-b2d7-0178e96f450e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:35:14.731605 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc22f415-de3d-4a33-b2d7-0178e96f450e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:35:14.732890 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc22f415-de3d-4a33-b2d7-0178e96f450e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:35:14.733782 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc22f415-de3d-4a33-b2d7-0178e96f450e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:35:14.785877 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-bb19d657-df95-4360-b915-aac793a7afbc req-a1acd280-6ac8-4a00-984c-f74e8c636ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a74e4cb-8108-4101-8dbe-c063481f2967", "tag": "9b7f8fc1-6d04-4211-ab6a-e06a963d8464"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:35:14.800275 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-bb19d657-df95-4360-b915-aac793a7afbc req-a1acd280-6ac8-4a00-984c-f74e8c636ff9 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:35:14.800995 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-bb19d657-df95-4360-b915-aac793a7afbc req-a1acd280-6ac8-4a00-984c-f74e8c636ff9 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:35:14.801602 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-bb19d657-df95-4360-b915-aac793a7afbc req-a1acd280-6ac8-4a00-984c-f74e8c636ff9 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:35:14.825521 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-bb19d657-df95-4360-b915-aac793a7afbc req-a1acd280-6ac8-4a00-984c-f74e8c636ff9 service nova] Creating event network-changed:9b7f8fc1-6d04-4211-ab6a-e06a963d8464 for instance 8a74e4cb-8108-4101-8dbe-c063481f2967 on hv-cinder-85199 Aug 26 18:35:14.834931 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-bb19d657-df95-4360-b915-aac793a7afbc req-a1acd280-6ac8-4a00-984c-f74e8c636ff9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.326683 Aug 26 18:35:14.836903 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 558/1130] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 18:35:14.921021 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cc22f415-de3d-4a33-b2d7-0178e96f450e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:35:14.930294 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cc22f415-de3d-4a33-b2d7-0178e96f450e tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1567 microversion: 2.1 time: 0.223386 Aug 26 18:35:14.931008 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 573/1131] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:35:14 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 18:35:15.954150 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-0b3e87dd-1e36-4c06-95ed-3d25b918fa9b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:35:15.954880 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-0b3e87dd-1e36-4c06-95ed-3d25b918fa9b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:35:15.961528 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0b3e87dd-1e36-4c06-95ed-3d25b918fa9b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:35:15.962022 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0b3e87dd-1e36-4c06-95ed-3d25b918fa9b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:35:15.962449 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0b3e87dd-1e36-4c06-95ed-3d25b918fa9b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:35:15.963170 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0b3e87dd-1e36-4c06-95ed-3d25b918fa9b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:35:15.963638 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0b3e87dd-1e36-4c06-95ed-3d25b918fa9b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:35:15.964301 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-0b3e87dd-1e36-4c06-95ed-3d25b918fa9b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:35:16.114898 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.policy [None req-0b3e87dd-1e36-4c06-95ed-3d25b918fa9b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120540) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:35:16.125287 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-0b3e87dd-1e36-4c06-95ed-3d25b918fa9b tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1567 microversion: 2.1 time: 0.176554 Aug 26 18:35:16.125953 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 559/1132] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:35:15 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:35:17.148515 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0b724d93-6cbc-49ae-a120-4a6358d4e9e2 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:35:17.149368 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0b724d93-6cbc-49ae-a120-4a6358d4e9e2 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:35:17.160565 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [req-d430202e-ae40-413e-b657-bdbddc2cda15 req-e25ff9ab-e4b6-42c9-b59a-fbffb97036f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a74e4cb-8108-4101-8dbe-c063481f2967", "name": "network-vif-deleted", "tag": "9b7f8fc1-6d04-4211-ab6a-e06a963d8464"}]} {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 18:35:17.166419 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b724d93-6cbc-49ae-a120-4a6358d4e9e2 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:35:17.167071 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b724d93-6cbc-49ae-a120-4a6358d4e9e2 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:35:17.167756 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b724d93-6cbc-49ae-a120-4a6358d4e9e2 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:35:17.168791 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b724d93-6cbc-49ae-a120-4a6358d4e9e2 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:35:17.169644 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b724d93-6cbc-49ae-a120-4a6358d4e9e2 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:35:17.170162 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-d430202e-ae40-413e-b657-bdbddc2cda15 req-e25ff9ab-e4b6-42c9-b59a-fbffb97036f1 service nova] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:35:17.170327 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b724d93-6cbc-49ae-a120-4a6358d4e9e2 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:35:17.170616 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-d430202e-ae40-413e-b657-bdbddc2cda15 req-e25ff9ab-e4b6-42c9-b59a-fbffb97036f1 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:35:17.171272 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [req-d430202e-ae40-413e-b657-bdbddc2cda15 req-e25ff9ab-e4b6-42c9-b59a-fbffb97036f1 service nova] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:35:17.183933 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.compute.server_external_events [req-d430202e-ae40-413e-b657-bdbddc2cda15 req-e25ff9ab-e4b6-42c9-b59a-fbffb97036f1 service nova] Creating event network-vif-deleted:9b7f8fc1-6d04-4211-ab6a-e06a963d8464 for instance 8a74e4cb-8108-4101-8dbe-c063481f2967 on hv-cinder-85199 Aug 26 18:35:17.189631 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [req-d430202e-ae40-413e-b657-bdbddc2cda15 req-e25ff9ab-e4b6-42c9-b59a-fbffb97036f1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033448 Aug 26 18:35:17.190626 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 560/1133] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Aug 26 18:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 18:35:17.260816 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0b724d93-6cbc-49ae-a120-4a6358d4e9e2 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0921be36eb4388a8e3098f5fba3ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2023d6404889439f8034ea56372395c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 18:35:17.268791 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0b724d93-6cbc-49ae-a120-4a6358d4e9e2 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 200 len: 1219 microversion: 2.1 time: 0.125047 Aug 26 18:35:17.269372 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 574/1134] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:35:17 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 1219 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 18:35:18.291313 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e86cbc92-c17d-43a4-a5b0-2f4526cc7f36 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '>' {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:35:18.291966 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.compute.api [None req-e86cbc92-c17d-43a4-a5b0-2f4526cc7f36 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] [instance: 8a74e4cb-8108-4101-8dbe-c063481f2967] Fetching instance by UUID {{(pid=120540) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 18:35:18.298800 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e86cbc92-c17d-43a4-a5b0-2f4526cc7f36 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:35:18.299283 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e86cbc92-c17d-43a4-a5b0-2f4526cc7f36 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:35:18.299718 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e86cbc92-c17d-43a4-a5b0-2f4526cc7f36 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:35:18.300408 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e86cbc92-c17d-43a4-a5b0-2f4526cc7f36 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Acquiring lock "b13be996-0005-4abd-8d43-d4c756a0aa08" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 18:35:18.300875 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e86cbc92-c17d-43a4-a5b0-2f4526cc7f36 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 18:35:18.301297 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG oslo_concurrency.lockutils [None req-e86cbc92-c17d-43a4-a5b0-2f4526cc7f36 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Lock "b13be996-0005-4abd-8d43-d4c756a0aa08" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 18:35:18.316080 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.wsgi [None req-e86cbc92-c17d-43a4-a5b0-2f4526cc7f36 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] HTTP exception thrown: Instance 8a74e4cb-8108-4101-8dbe-c063481f2967 could not be found. Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e86cbc92-c17d-43a4-a5b0-2f4526cc7f36 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Request method failure captured: Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: request: GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 HTTP/1.1 Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept: application/json Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Accept-Encoding: identity Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Connection: close Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Length: 0 Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Content-Type: application/json Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Host: 10.222.0.45 Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: Openstack-System-Scope: None Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: User-Agent: python-urllib3/1.26.11 Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Auth-Token: gAAAAABjCRFM6A-Rgh8eV3lYemmY9M92EpqfAJrQKuj4zk88fUtJd8WD8H5eqjm8TmKEyCEQOO2Rz0Nu-cdOY0DQY5isF9mMM8J88MLthRYEKZMrgDxgRVxB1W3et3p4AcWwDDZ8uY4A5f7X-1aIR_Gx3Ls-lcMCEW4LwW7lOlK7UO4SQ-J12Nc Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Id: None Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Domain-Name: None Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Identity-Status: Confirmed Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Is-Admin-Project: True Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Id: default Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Domain-Name: Default Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Id: 2023d6404889439f8034ea56372395c1 Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Project-Name: tempest-TestShelveInstance-1864661203 Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Role: reader,member Aug 26 18:35:18.317761 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Roles: reader,member Aug 26 18:35:18.319728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2023d6404889439f8034ea56372395c1", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2023d6404889439f8034ea56372395c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2023d6404889439f8034ea56372395c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2023d6404889439f8034ea56372395c1"}]}] Aug 26 18:35:18.319728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant: tempest-TestShelveInstance-1864661203 Aug 26 18:35:18.319728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Id: 2023d6404889439f8034ea56372395c1 Aug 26 18:35:18.319728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-Tenant-Name: tempest-TestShelveInstance-1864661203 Aug 26 18:35:18.319728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User: tempest-TestShelveInstance-1864661203-project Aug 26 18:35:18.319728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Id: default Aug 26 18:35:18.319728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Domain-Name: Default Aug 26 18:35:18.319728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Id: fd0921be36eb4388a8e3098f5fba3ee7 Aug 26 18:35:18.319728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: X-User-Name: tempest-TestShelveInstance-1864661203-project Aug 26 18:35:18.319728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: method: > Aug 26 18:35:18.319728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: exception: Instance 8a74e4cb-8108-4101-8dbe-c063481f2967 could not be found. Aug 26 18:35:18.319728 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: action_args: {'id': '8a74e4cb-8108-4101-8dbe-c063481f2967'} Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: {{(pid=120540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a74e4cb-8108-4101-8dbe-c063481f2967 could not be found. Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 18:35:18.321075 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a74e4cb-8108-4101-8dbe-c063481f2967 could not be found. Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a74e4cb-8108-4101-8dbe-c063481f2967 could not be found. Aug 26 18:35:18.324186 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: ERROR nova.api.openstack.wsgi Aug 26 18:35:18.327176 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: DEBUG nova.api.openstack.wsgi [None req-e86cbc92-c17d-43a4-a5b0-2f4526cc7f36 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Returning 404 to user: Instance 8a74e4cb-8108-4101-8dbe-c063481f2967 could not be found. {{(pid=120540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 18:35:18.327176 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: INFO nova.api.openstack.requestlog [None req-e86cbc92-c17d-43a4-a5b0-2f4526cc7f36 tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967" status: 404 len: 111 microversion: 2.1 time: 0.032910 Aug 26 18:35:18.327176 dv-cinder-851996-8-iscsi devstack@n-api.service[120540]: [pid: 120540|app: 0|req: 561/1135] 10.222.0.45 () {58 vars in 1236 bytes} [Fri Aug 26 18:35:18 2022] GET /compute/v2.1/servers/8a74e4cb-8108-4101-8dbe-c063481f2967 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 18:35:18.505616 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0a1ace5d-f5dc-4583-a867-ac15d621444f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] Calling method '.version_select at 0x7fc74426c0d0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 18:35:18.533547 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0a1ace5d-f5dc-4583-a867-ac15d621444f tempest-TestShelveInstance-1864661203 tempest-TestShelveInstance-1864661203-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1376437212" status: 202 len: 0 microversion: 2.1 time: 0.039588 Aug 26 18:35:18.534348 dv-cinder-851996-8-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 575/1136] 10.222.0.45 () {58 vars in 1254 bytes} [Fri Aug 26 18:35:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1376437212 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)